Sep 15 21:08:24.427943 ip-10-0-137-138 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 21:08:24.836049 ip-10-0-137-138 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:08:24.836049 ip-10-0-137-138 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 21:08:24.836049 ip-10-0-137-138 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:08:24.836049 ip-10-0-137-138 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 21:08:24.836049 ip-10-0-137-138 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:08:24.838625 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.838505    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 21:08:24.842468 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842446    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.842468 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842464    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.842468 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842469    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.842468 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842473    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.842468 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842477    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842482    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842486    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842490    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842493    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842497    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842501    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842504    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842508    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842512    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842516    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842520    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842524    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842527    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842531    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842535    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842539    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842559    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842563    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842567    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.842781 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842570    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842574    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842580    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842584    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842587    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842605    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842610    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842613    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842617    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842621    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842625    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842630    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842634    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842640    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842645    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842649    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842654    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842661    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842669    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.843560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842675    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842680    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842684    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842690    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842696    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842702    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842706    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842710    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842715    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842719    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842723    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842736    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842740    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842744    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842749    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842753    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842758    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842762    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842766    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.844321 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842770    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842775    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842778    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842782    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842786    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842790    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842794    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842799    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842804    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842808    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842813    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842817    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842821    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842826    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842830    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842834    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842838    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842842    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842847    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842851    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.844814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842855    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842862    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842868    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842873    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842884    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842897    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842902    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842908    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842912    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842916    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842920    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842924    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842929    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842934    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842938    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842942    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.842946    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844942    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844956    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844960    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.845304 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844963    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844967    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844972    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844976    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844979    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844982    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844986    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844989    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844992    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844995    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.844997    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845000    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845003    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845006    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845008    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845011    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845013    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845016    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845019    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845021    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.845814 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845024    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845026    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845029    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845031    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845034    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845036    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845039    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845042    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845044    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845047    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845051    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845054    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845057    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845059    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845062    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845065    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845067    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845071    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845073    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845075    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.846320 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845078    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845080    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845083    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845086    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845088    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845091    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845094    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845096    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845099    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845101    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845104    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845108    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845111    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845114    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845116    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845118    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845121    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845123    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845126    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845129    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.846843 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845131    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845134    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845137    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845140    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845143    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845146    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845154    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845157    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845160    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845162    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845165    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845167    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845170    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845172    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845175    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845178    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845180    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845183    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845185    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845187    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.847344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845191    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845193    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845196    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845198    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845201    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845203    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845206    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845208    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845211    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845213    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845216    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845219    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845222    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845225    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845229    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845233    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845639    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845646    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845650    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.847846 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845653    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845656    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845659    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845662    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845665    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845667    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845670    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845673    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845676    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845678    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845681    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845683    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845686    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845689    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845691    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845694    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845697    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845699    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845702    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845704    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.848344 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845707    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845709    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845711    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845714    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845717    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845719    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845722    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845725    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845728    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845731    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845733    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845736    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845738    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845741    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845743    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845745    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845748    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845750    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845753    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845755    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.848855 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845758    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845760    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845763    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845767    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845770    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845773    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845776    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845780    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845783    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845786    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845789    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845792    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845795    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845797    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845800    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845803    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845805    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845808    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845811    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.849339 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845813    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845816    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845819    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845821    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845824    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845827    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845829    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845832    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845834    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845837    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845839    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845842    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845844    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845846    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845849    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845852    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845855    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845857    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845860    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845862    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.849862 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845865    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845867    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845870    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845873    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845875    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845878    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845880    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845883    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845885    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845888    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845890    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845893    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845896    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845899    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845901    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845903    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.845906    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.845987    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846029    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846036    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 21:08:24.850346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846040    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846044    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846048    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846052    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846057    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846061    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846064    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846068    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846072    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846075    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846078    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846081    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846085    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846089    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846092    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846097    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846100    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846103    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846107    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846110    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846118    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846121    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846124    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 21:08:24.850848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846128    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846131    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846134    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846137    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846140    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846143    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846147    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846150    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846153    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846157    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846159    2560 flags.go:64] FLAG: --enable-server="true"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846162    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846167    2560 flags.go:64] FLAG: --event-burst="100"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846170    2560 flags.go:64] FLAG: --event-qps="50"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846172    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846176    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846179    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846183    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846186    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846189    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846192    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846195    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846197    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846201    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846206    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 21:08:24.851437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846209    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846212    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846215    2560 flags.go:64] FLAG: --feature-gates=""
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846219    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846222    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846225    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846229    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846232    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846235    2560 flags.go:64] FLAG: --help="false"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846238    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-137-138.ec2.internal"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846241    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846244    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846247    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846250    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846253    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846258    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846261    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846264    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846267    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846270    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846273    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846277    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846280    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846283    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 21:08:24.852079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846286    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846289    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846292    2560 flags.go:64] FLAG: --lock-file=""
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846295    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846298    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846301    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846310    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846316    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846319    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846322    2560 flags.go:64] FLAG: --logging-format="text"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846325    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846328    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846331    2560 flags.go:64] FLAG: --manifest-url=""
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846334    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846339    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846342    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846346    2560 flags.go:64] FLAG: --max-pods="110"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846349    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846352    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846354    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846358    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846361    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846364    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846368    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846376    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 21:08:24.852903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846379    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846382    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846385    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846388    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846394    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846397    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846400    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846403    2560 flags.go:64] FLAG: --port="10250"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846406    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846410    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0221a7e5b2ed84929"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846413    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846416    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846419    2560 flags.go:64] FLAG: --register-node="true"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846422    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846426    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846431    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846433    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846436    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846440    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846443    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846446    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846449    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846453    2560 flags.go:64] FLAG: --runonce="false"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846455    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846458    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 21:08:24.853969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846461    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846464    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846467    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846470    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846473    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846477    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846480    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846483    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846486    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846489    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846492    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846495    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846498    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846503    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846506    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846508    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846513    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846516    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846519    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846521    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846524    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846527    2560 flags.go:64] FLAG: --v="2"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846533    2560 flags.go:64] FLAG: --version="false"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846537    2560 flags.go:64] FLAG: --vmodule=""
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846541    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 21:08:24.855061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846544    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846685    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846690    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846693    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846696    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846699    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846701    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846705    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846709    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846712    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846715    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846718    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846722    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846725    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846728    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846730    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846733    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846736    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846739    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.856161 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846742    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846744    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846747    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846750    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846753    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846755    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846758    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846761    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846763    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846766    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846770    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846773    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846777    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846780    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846783    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846785    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846788    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846790    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846793    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846795    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846798    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.857038 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846801    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846803    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846806    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846808    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846812    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846815    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846817    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846820    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846822    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846825    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846828    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846831    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846833    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846836    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846838    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846841    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846843    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846846    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846849    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846852    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.857928 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846854    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846859    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846863    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846867    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846870    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846873    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846876    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846881    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846885    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846889    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846893    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846899    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846903    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846906    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846909    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846912    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846919    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846922    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846925    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.858641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846928    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846931    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846934    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846937    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846939    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846942    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846945    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846948    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846951    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846954    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846957    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846960    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846962    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846965    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846969    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846972    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846975    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846978    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846981    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846984    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.859261 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.846987    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.846993    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.854775    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.854797    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.854825    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.854834    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854933    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854941    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854947    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854952    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854957    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854961    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854966    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854970    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854974    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.859774 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854978    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854982    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854986    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854991    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854995    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.854999    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855003    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855007    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855012    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855016    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855020    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855025    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855029    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855033    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855037    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855042    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855046    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855051    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855056    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855059    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.860210 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855064    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855068    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855072    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855076    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855080    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855085    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855088    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855092    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855096    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855100    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855105    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855109    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855114    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855118    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855122    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855127    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855131    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855136    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855140    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855145    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.860745 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855149    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855156    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855162    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855168    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855173    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855178    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855183    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855187    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855193    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855198    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855202    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855206    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855211    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855215    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855219    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855224    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855228    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855232    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855237    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.861312 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855241    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855245    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855249    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855253    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855258    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855262    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855266    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855271    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855275    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855280    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855284    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855288    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855292    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855297    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855301    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855305    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855310    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855314    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855318    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855322    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.861994 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855326    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855331    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855335    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855340    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855344    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855351    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855357    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855362    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855366    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855372    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855379    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.855387    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855577    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855584    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855589    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:08:24.862823 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855609    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855614    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855618    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855623    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855627    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855631    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855635    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855639    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855643    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855647    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855652    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855658    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855663    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855669    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855674    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855678    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855683    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855688    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855693    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:08:24.863443 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855697    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855703    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855707    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855712    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855716    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855721    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855725    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855729    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855734    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855738    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855742    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855746    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855750    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855754    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855758    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855762    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855766    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855770    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855774    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855779    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:08:24.864263 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855783    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855789    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855794    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855799    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855804    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855808    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855813    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855817    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855822    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855826    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855830    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855835    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855839    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855843    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855848    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855852    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855857    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855861    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855865    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855869    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:08:24.864906 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855874    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855880    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855886    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855891    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855896    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855900    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855904    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855909    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855913    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855918    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855922    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855926    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855931    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855935    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855939    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855943    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855947    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855951    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855956    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:08:24.865430 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855960    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855964    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855968    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855973    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855977    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855981    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855985    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855989    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855995    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.855999    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856003    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856007    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856011    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856016    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856020    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856024    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856028    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:08:24.865948 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:24.856032    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.856040    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.856217    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.858890    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.859934    2560 server.go:1019] "Starting client certificate rotation"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.860043    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.860079    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.862786    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 21:08:24.866363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.864617    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 21:08:24.876306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.876282    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 15 21:08:24.879268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.879242    2560 log.go:25] "Validated CRI v1 image API"
Sep 15 21:08:24.880061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.880045    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 21:08:24.884180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.884156    2560 fs.go:135] Filesystem UUIDs: map[1e2de344-e0e1-4328-b190-5da780fdef7e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 93256610-7473-4545-9257-88d299a6287a:/dev/nvme0n1p4]
Sep 15 21:08:24.884273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.884177    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 21:08:24.890369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.890255    2560 manager.go:216] Machine: {Timestamp:2026-09-15 21:08:24.888879159 +0000 UTC m=+0.345542150 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100820 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23065bec4084c495924165033fe82d SystemUUID:ec23065b-ec40-84c4-9592-4165033fe82d BootID:8288b92b-70fe-4f94-b0a0-6f9d73094a61 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f6:f0:21:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f6:f0:21:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:f6:15:51:20:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 21:08:24.890369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.890362    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 21:08:24.890487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.890455    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 21:08:24.893694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.893658    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 21:08:24.893898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.893698    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 21:08:24.893950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.893892    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 21:08:24.894496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.894484    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 21:08:24.894530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.894499    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 21:08:24.894530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.894508    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 21:08:24.894530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.894523    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 21:08:24.895348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.895338    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 21:08:24.898782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898770    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 21:08:24.898922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898912    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 21:08:24.898958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898943    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 21:08:24.898958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898956    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 21:08:24.899015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898978    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 21:08:24.899015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.898991    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 15 21:08:24.899015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.899007    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 21:08:24.899471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.899455    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 21:08:24.899525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.899479    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 21:08:24.902035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.902006    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 21:08:24.904003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.903989    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 21:08:24.904077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.904019    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 21:08:24.905672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905657    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905676    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905683    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905689    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905698    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905704    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905718    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905724    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905738    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905746    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905755    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 21:08:24.905759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.905760    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 21:08:24.906407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.906394    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 21:08:24.906447 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.906410    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 21:08:24.909948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.909928    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 21:08:24.910129 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.910109    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 21:08:24.910172 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.910111    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 21:08:24.910332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.910321    2560 server.go:1268] "Started kubelet"
Sep 15 21:08:24.910398 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.910363    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 21:08:24.910444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.910392    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 21:08:24.910503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.910490    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 21:08:24.911364 ip-10-0-137-138 systemd[1]: Started Kubernetes Kubelet.
Sep 15 21:08:24.915411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.915357    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 21:08:24.918583 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.918560    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 21:08:24.919404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.919388    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 21:08:24.920634 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.919778    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-138.ec2.internal.18d59aaf5c6dcd52  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-138.ec2.internal,UID:ip-10-0-137-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-138.ec2.internal,},FirstTimestamp:2026-09-15 21:08:24.910294354 +0000 UTC m=+0.366957345,LastTimestamp:2026-09-15 21:08:24.910294354 +0000 UTC m=+0.366957345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-138.ec2.internal,}"
Sep 15 21:08:24.921978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.921953    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 21:08:24.922345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.922324    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wnvzd"
Sep 15 21:08:24.922522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.922503    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 21:08:24.922653 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.922635    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:24.923089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923074    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 21:08:24.923162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923096    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 21:08:24.923162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923121    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 21:08:24.923275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923250    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 21:08:24.923275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923259    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 21:08:24.923446 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923431    2560 factory.go:55] Registering systemd factory
Sep 15 21:08:24.923500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923449    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 15 21:08:24.923661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923648    2560 factory.go:153] Registering CRI-O factory
Sep 15 21:08:24.923707 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923666    2560 factory.go:223] Registration of the crio container factory successfully
Sep 15 21:08:24.923737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923715    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 21:08:24.923737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923729    2560 factory.go:103] Registering Raw factory
Sep 15 21:08:24.923812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.923740    2560 manager.go:1196] Started watching for new ooms in manager
Sep 15 21:08:24.924163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.924150    2560 manager.go:349] Starting recovery of all containers
Sep 15 21:08:24.932423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.932399    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wnvzd"
Sep 15 21:08:24.934219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.934192    2560 manager.go:354] Recovery completed
Sep 15 21:08:24.934342 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.934321    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 21:08:24.935000 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.934970    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 21:08:24.939939 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.939814    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:24.941882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.941866    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:24.941943 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.941897    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:24.941943 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.941907    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:24.942496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.942480    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 21:08:24.942496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.942494    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:24.942630 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.942495    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 21:08:24.942630 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.942560    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 21:08:24.943222 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943207    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:24.943276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943236    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:24.943276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943250    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:24.943630 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943618    2560 policy_none.go:49] "None policy: Start"
Sep 15 21:08:24.943692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943637    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 21:08:24.943692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.943651    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 21:08:24.944903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.944892    2560 policy_none.go:47] "Start"
Sep 15 21:08:24.993391 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.993368    2560 manager.go:337] "Starting Device Plugin manager"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.993428    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.993444    2560 server.go:87] "Starting device plugin registration server"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.993840    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.993854    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.993949    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.994058    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:24.994068    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.994670    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 21:08:24.995102 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:24.994723    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.021703 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.021661    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 21:08:25.022855 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.022826    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 21:08:25.022949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.022873    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 21:08:25.022949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.022902    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 21:08:25.023043 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.022977    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 21:08:25.024965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.024944    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:08:25.094744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.094637    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:25.096343 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.096321    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:25.096419 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.096365    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:25.096419 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.096380    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:25.096419 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.096410    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.102107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.102087    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.102174 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.102116    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-138.ec2.internal\": node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.116605 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.116562    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.123779 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.123753    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"]
Sep 15 21:08:25.123920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.123834    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:25.124863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.124843    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:25.124940 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.124873    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:25.124940 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.124890    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:25.126081 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126068    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:25.126253 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.126289 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126269    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:25.126824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126812    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:25.126879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126835    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:25.126879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126849    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:25.126944 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126878    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:25.126944 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126894    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:25.126944 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.126907    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:25.128040 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.128024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.128092 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.128058    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:08:25.128765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.128741    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:08:25.128873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.128773    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:08:25.128873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.128788    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:08:25.151554 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.151530    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-138.ec2.internal\" not found" node="ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.155895 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.155876    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-138.ec2.internal\" not found" node="ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.217559 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.217522    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.224811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.224790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.224892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.224817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.224892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.224835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.318612 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.318564    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.325938 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.325909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.326030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.325947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.326030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.325968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.326169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.326040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.326169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.326052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.326169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.326098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.419462 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.419379    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.454877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.454844    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.458750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.458662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:25.520209 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.520171    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.620746 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.620712    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.721350 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.721269    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.821935 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.821892    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.859328 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.859296    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 21:08:25.859897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.859493    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 21:08:25.922182 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:25.922153    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:25.936997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.936967    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 21:03:25 +0000 UTC" deadline="2028-04-13 09:29:10.586987772 +0000 UTC"
Sep 15 21:08:25.936997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:25.936993    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13812h20m44.649997449s"
Sep 15 21:08:26.022314 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.022240    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:26.122447 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.122408    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:26.222859 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.222830    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:26.270263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.270229    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:08:26.323674 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.323588    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:26.343027 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:26.342980    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5fe63d2e1dec62eab5d7d2258fa34d2.slice/crio-0ea15a5edcea9d5515bd7629fc8e56fd22e6f230a4a2542674e938cc69098077 WatchSource:0}: Error finding container 0ea15a5edcea9d5515bd7629fc8e56fd22e6f230a4a2542674e938cc69098077: Status 404 returned error can't find the container with id 0ea15a5edcea9d5515bd7629fc8e56fd22e6f230a4a2542674e938cc69098077
Sep 15 21:08:26.349678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.349658    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:08:26.354794 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:26.354770    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9c349dff749c2683923cdd68686644.slice/crio-6363d4bb8b8acaf65e36bc15417db52d49e3ad339f12e8de2cd187f28631eefb WatchSource:0}: Error finding container 6363d4bb8b8acaf65e36bc15417db52d49e3ad339f12e8de2cd187f28631eefb: Status 404 returned error can't find the container with id 6363d4bb8b8acaf65e36bc15417db52d49e3ad339f12e8de2cd187f28631eefb
Sep 15 21:08:26.423902 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.423859    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 21:08:26.447826 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.447804    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:08:26.495865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.495839    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:08:26.523086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.523057    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:26.535753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.535733    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 21:08:26.536901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.536885    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 21:08:26.545977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.545952    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 21:08:26.900568 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.900537    2560 apiserver.go:52] "Watching apiserver"
Sep 15 21:08:26.908678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.908652    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 21:08:26.909022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.908997    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vrpwz","kube-system/global-pull-secret-syncer-2sps5","kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pdwqw","openshift-multus/multus-additional-cni-plugins-c8xpg","openshift-multus/multus-czt5k","openshift-network-diagnostics/network-check-target-whzs8","openshift-network-operator/iptables-alerter-77wsf","kube-system/konnectivity-agent-9gvnl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2","openshift-dns/node-resolver-jzd2b","openshift-image-registry/node-ca-55tj8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal","openshift-multus/network-metrics-daemon-mv7mh"]
Sep 15 21:08:26.910819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.910799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:26.910921 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.910879    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:26.911980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.911953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:26.913363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.913342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:26.913444 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.913424    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:26.914934 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.914915    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.915337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.915141    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.915337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.915319    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.916554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.916528    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sg7ng\""
Sep 15 21:08:26.917373 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.917351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.918140 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.918087    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.919395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.919377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vksqf\""
Sep 15 21:08:26.919543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.919377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.919718 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.919566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.920057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.920037    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 21:08:26.920153 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.920094    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.920379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.920362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.920469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.920378    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 21:08:26.920530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.920469    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2tzc4\""
Sep 15 21:08:26.921097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.921077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:26.921205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.921170    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 21:08:26.921998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.921979    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 21:08:26.922089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.922007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bs4hx\""
Sep 15 21:08:26.922367 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.922202    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 21:08:26.923614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.922917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:26.923614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.923438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hd2v\""
Sep 15 21:08:26.923614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.923485    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 21:08:26.923614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.923497    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 21:08:26.924089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.924063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:26.924152 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:26.924128    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:26.925238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.925219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7259v\""
Sep 15 21:08:26.925336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.925257    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.925336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.925266    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 21:08:26.925336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.925310    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.925710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.925690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:26.927722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.927705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:26.928429 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.928411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.928537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.928474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wm2rn\""
Sep 15 21:08:26.928686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.928666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 21:08:26.928805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.928788    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.929193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.929173    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:26.930212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930193    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 21:08:26.930292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930262    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 21:08:26.930438 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930420    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.930639 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 21:08:26.930742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zwml2\""
Sep 15 21:08:26.930742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.930742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.930729    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 21:08:26.931505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.931485    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 21:08:26.931614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.931532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 21:08:26.931831 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.931814    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 21:08:26.931896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.931884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hv2xw\""
Sep 15 21:08:26.933749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.933725    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 21:08:26.934354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-hostroot\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.934445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-etc-kubernetes\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.934445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpcv8\" (UniqueName: \"kubernetes.io/projected/473d8145-d052-4ea7-9f03-db82c4c87f54-kube-api-access-vpcv8\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.934445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-conf\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-systemd\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-var-lib-kubelet\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-system-cni-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5f6d62e-ae03-48c1-a87d-e0049652442b-agent-certs\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:26.934611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-hosts-file\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-cni-binary-copy\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdshg\" (UniqueName: \"kubernetes.io/projected/be174629-7667-4599-b792-257633f812fa-kube-api-access-jdshg\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-host\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5f6d62e-ae03-48c1-a87d-e0049652442b-konnectivity-ca\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-cnibin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cbdbd1c-7999-4a61-aa40-65ac52349a93-iptables-alerter-script\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-run\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-lib-modules\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.934878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-etc-tuned\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-cnibin\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.934983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-kubelet\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-kubernetes\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6fmt\" (UniqueName: \"kubernetes.io/projected/52acb764-0b0e-428c-967a-3ec871127556-kube-api-access-k6fmt\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-daemon-config\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-multus-certs\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysconfig\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-sys\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-tmp\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.935305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbzz\" (UniqueName: \"kubernetes.io/projected/d9d47377-618b-4b22-b2ac-db15aa42eac7-kube-api-access-cnbzz\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-system-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-dbus\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntldt\" (UniqueName: \"kubernetes.io/projected/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-kube-api-access-ntldt\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-socket-dir-parent\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-k8s-cni-cncf-io\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-netns\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-bin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-conf-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-multus\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cbdbd1c-7999-4a61-aa40-65ac52349a93-host-slash\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf77g\" (UniqueName: \"kubernetes.io/projected/4cbdbd1c-7999-4a61-aa40-65ac52349a93-kube-api-access-cf77g\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-modprobe-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:26.935913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-kubelet-config\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:26.936363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.935809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-tmp-dir\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:26.966803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.966772    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8f8nr"
Sep 15 21:08:26.977259 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:26.977230    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8f8nr"
Sep 15 21:08:27.024551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.024524    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 21:08:27.028410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.028333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerStarted","Data":"6363d4bb8b8acaf65e36bc15417db52d49e3ad339f12e8de2cd187f28631eefb"}
Sep 15 21:08:27.029492 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.029458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" event={"ID":"d5fe63d2e1dec62eab5d7d2258fa34d2","Type":"ContainerStarted","Data":"0ea15a5edcea9d5515bd7629fc8e56fd22e6f230a4a2542674e938cc69098077"}
Sep 15 21:08:27.036697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.036697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-multus\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095bf5ce-872e-4af2-8788-b244fddf4634-host\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-kubelet-config\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-tmp-dir\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-hostroot\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-conf\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-multus\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-systemd\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.036863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-kubelet-config\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-hostroot\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-systemd\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-var-lib-kubelet\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5f6d62e-ae03-48c1-a87d-e0049652442b-agent-certs\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-hosts-file\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-conf\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-var-lib-kubelet\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.036979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-hosts-file\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-tmp-dir\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5f6d62e-ae03-48c1-a87d-e0049652442b-konnectivity-ca\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:27.037230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-cnibin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54wg\" (UniqueName: \"kubernetes.io/projected/095bf5ce-872e-4af2-8788-b244fddf4634-kube-api-access-c54wg\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-systemd-units\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-netd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rsbk\" (UniqueName: \"kubernetes.io/projected/ffe471ec-cc51-4289-8517-1a03344f332e-kube-api-access-5rsbk\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-etc-tuned\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037454    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-cnibin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-cnibin\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-kubelet\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-daemon-config\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5f6d62e-ae03-48c1-a87d-e0049652442b-konnectivity-ca\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095bf5ce-872e-4af2-8788-b244fddf4634-serviceca\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.037892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-cnibin\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-config\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-etc-kubernetes\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpcv8\" (UniqueName: \"kubernetes.io/projected/473d8145-d052-4ea7-9f03-db82c4c87f54-kube-api-access-vpcv8\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysconfig\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-etc-kubernetes\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-sys\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysconfig\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.037985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-tmp\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-sys\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbzz\" (UniqueName: \"kubernetes.io/projected/d9d47377-618b-4b22-b2ac-db15aa42eac7-kube-api-access-cnbzz\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-daemon-config\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-system-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-system-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-cni-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-dbus\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:27.038532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntldt\" (UniqueName: \"kubernetes.io/projected/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-kube-api-access-ntldt\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa798427-090b-45b1-89e4-1f85583f438d-dbus\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-socket-dir-parent\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-k8s-cni-cncf-io\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-bin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-netns\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-k8s-cni-cncf-io\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-socket-dir-parent\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-cni-bin\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cbdbd1c-7999-4a61-aa40-65ac52349a93-host-slash\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf77g\" (UniqueName: \"kubernetes.io/projected/4cbdbd1c-7999-4a61-aa40-65ac52349a93-kube-api-access-cf77g\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cbdbd1c-7999-4a61-aa40-65ac52349a93-host-slash\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrpt\" (UniqueName: \"kubernetes.io/projected/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kube-api-access-qmrpt\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-ovn\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.039331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-bin\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-modprobe-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-var-lib-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe471ec-cc51-4289-8517-1a03344f332e-ovn-node-metrics-cert\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-system-cni-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.038978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-cni-binary-copy\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.038966    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-env-overrides\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdshg\" (UniqueName: \"kubernetes.io/projected/be174629-7667-4599-b792-257633f812fa-kube-api-access-jdshg\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.039061    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:27.539028548 +0000 UTC m=+2.995691548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-host\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cbdbd1c-7999-4a61-aa40-65ac52349a93-iptables-alerter-script\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-slash\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-run\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-lib-modules\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-kubelet\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-multus-certs\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-etc-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-modprobe-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-node-log\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-var-lib-kubelet\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-lib-modules\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-multus-certs\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-run\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-script-lib\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-kubernetes\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-host\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6fmt\" (UniqueName: \"kubernetes.io/projected/52acb764-0b0e-428c-967a-3ec871127556-kube-api-access-k6fmt\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-system-cni-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-device-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/473d8145-d052-4ea7-9f03-db82c4c87f54-cni-binary-copy\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.040745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-log-socket\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-kubernetes\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.039933    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.039974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.039989    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:27.539972949 +0000 UTC m=+2.996635943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-netns\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-conf-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-systemd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52acb764-0b0e-428c-967a-3ec871127556-etc-sysctl-d\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d47377-618b-4b22-b2ac-db15aa42eac7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cbdbd1c-7999-4a61-aa40-65ac52349a93-iptables-alerter-script\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-host-run-netns\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/473d8145-d052-4ea7-9f03-db82c4c87f54-multus-conf-dir\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.040452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d47377-618b-4b22-b2ac-db15aa42eac7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.041165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-etc-tuned\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.041614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.041280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52acb764-0b0e-428c-967a-3ec871127556-tmp\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.042218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.042149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5f6d62e-ae03-48c1-a87d-e0049652442b-agent-certs\") pod \"konnectivity-agent-9gvnl\" (UID: \"d5f6d62e-ae03-48c1-a87d-e0049652442b\") " pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:27.044636 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.044617    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:27.044741 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.044644    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:27.044741 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.044657    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:27.044845 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:27.044761    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:27.544743269 +0000 UTC m=+3.001406266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:27.047338 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.047317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbzz\" (UniqueName: \"kubernetes.io/projected/d9d47377-618b-4b22-b2ac-db15aa42eac7-kube-api-access-cnbzz\") pod \"multus-additional-cni-plugins-c8xpg\" (UID: \"d9d47377-618b-4b22-b2ac-db15aa42eac7\") " pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.047414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.047365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpcv8\" (UniqueName: \"kubernetes.io/projected/473d8145-d052-4ea7-9f03-db82c4c87f54-kube-api-access-vpcv8\") pod \"multus-czt5k\" (UID: \"473d8145-d052-4ea7-9f03-db82c4c87f54\") " pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.052282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.052222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6fmt\" (UniqueName: \"kubernetes.io/projected/52acb764-0b0e-428c-967a-3ec871127556-kube-api-access-k6fmt\") pod \"tuned-pdwqw\" (UID: \"52acb764-0b0e-428c-967a-3ec871127556\") " pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.052561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.052539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntldt\" (UniqueName: \"kubernetes.io/projected/3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b-kube-api-access-ntldt\") pod \"node-resolver-jzd2b\" (UID: \"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b\") " pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.052642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.052565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf77g\" (UniqueName: \"kubernetes.io/projected/4cbdbd1c-7999-4a61-aa40-65ac52349a93-kube-api-access-cf77g\") pod \"iptables-alerter-77wsf\" (UID: \"4cbdbd1c-7999-4a61-aa40-65ac52349a93\") " pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.052642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.052583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdshg\" (UniqueName: \"kubernetes.io/projected/be174629-7667-4599-b792-257633f812fa-kube-api-access-jdshg\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:27.140922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.140890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.140939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-netns\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.140962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.140985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrpt\" (UniqueName: \"kubernetes.io/projected/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kube-api-access-qmrpt\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-ovn\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-netns\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-bin\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-var-lib-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-var-lib-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe471ec-cc51-4289-8517-1a03344f332e-ovn-node-metrics-cert\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-env-overrides\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-slash\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-bin\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-etc-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-ovn\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-node-log\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-script-lib\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-device-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-log-socket\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-node-log\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-systemd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-etc-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.141635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095bf5ce-872e-4af2-8788-b244fddf4634-host\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-slash\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-device-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095bf5ce-872e-4af2-8788-b244fddf4634-host\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-systemd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-log-socket\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54wg\" (UniqueName: \"kubernetes.io/projected/095bf5ce-872e-4af2-8788-b244fddf4634-kube-api-access-c54wg\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-systemd-units\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-netd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rsbk\" (UniqueName: \"kubernetes.io/projected/ffe471ec-cc51-4289-8517-1a03344f332e-kube-api-access-5rsbk\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-systemd-units\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-kubelet\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-cni-netd\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-host-kubelet\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095bf5ce-872e-4af2-8788-b244fddf4634-serviceca\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-config\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.141927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ffe471ec-cc51-4289-8517-1a03344f332e-run-openvswitch\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.142027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-env-overrides\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.142182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095bf5ce-872e-4af2-8788-b244fddf4634-serviceca\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.142393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-config\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.142917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.142565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ffe471ec-cc51-4289-8517-1a03344f332e-ovnkube-script-lib\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.143941 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.143919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffe471ec-cc51-4289-8517-1a03344f332e-ovn-node-metrics-cert\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.149801 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.149781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrpt\" (UniqueName: \"kubernetes.io/projected/d1e9121b-e2d0-40b2-ba46-ca5421f38eae-kube-api-access-qmrpt\") pod \"aws-ebs-csi-driver-node-f5bt2\" (UID: \"d1e9121b-e2d0-40b2-ba46-ca5421f38eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.150951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.150897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rsbk\" (UniqueName: \"kubernetes.io/projected/ffe471ec-cc51-4289-8517-1a03344f332e-kube-api-access-5rsbk\") pod \"ovnkube-node-vrpwz\" (UID: \"ffe471ec-cc51-4289-8517-1a03344f332e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.151098 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.151081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54wg\" (UniqueName: \"kubernetes.io/projected/095bf5ce-872e-4af2-8788-b244fddf4634-kube-api-access-c54wg\") pod \"node-ca-55tj8\" (UID: \"095bf5ce-872e-4af2-8788-b244fddf4634\") " pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:27.225453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.225423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzd2b"
Sep 15 21:08:27.232485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.232457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pdwqw"
Sep 15 21:08:27.239898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.239871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8xpg"
Sep 15 21:08:27.243491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.243471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-czt5k"
Sep 15 21:08:27.248648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.248624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:27.255860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.255831    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77wsf"
Sep 15 21:08:27.264651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.264625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2"
Sep 15 21:08:27.273767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.273615    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:27.279090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:27.279066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55tj8"
Sep 15 21:08:28.494542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:28.494461    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:28.597391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:28.597442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:28.597508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597563    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597618    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597634    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597654    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597667    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597637    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:29.597616553 +0000 UTC m=+4.001938633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:28.597699 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597725    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:29.597709289 +0000 UTC m=+4.002031321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:28.598289 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:28.597742    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:29.597732831 +0000 UTC m=+4.002054859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:29.031931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.031881    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:03:28 +0000 UTC" deadline="2028-03-02 07:47:52.870562249 +0000 UTC"
Sep 15 21:08:29.031931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.031928    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12802h39m23.838638926s"
Sep 15 21:08:29.076888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.076362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:29.076888 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.076488    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:29.403735 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.403706    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f6d62e_ae03_48c1_a87d_e0049652442b.slice/crio-94afd59529ce00c6388ceb4891dd79584d0856b65e148ec8310f68ca7f9d2aab WatchSource:0}: Error finding container 94afd59529ce00c6388ceb4891dd79584d0856b65e148ec8310f68ca7f9d2aab: Status 404 returned error can't find the container with id 94afd59529ce00c6388ceb4891dd79584d0856b65e148ec8310f68ca7f9d2aab
Sep 15 21:08:29.418792 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.418633    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095bf5ce_872e_4af2_8788_b244fddf4634.slice/crio-012b85f31dc9a388ff8b91e88af53169d66f22eab593c1df8836f75e5e827769 WatchSource:0}: Error finding container 012b85f31dc9a388ff8b91e88af53169d66f22eab593c1df8836f75e5e827769: Status 404 returned error can't find the container with id 012b85f31dc9a388ff8b91e88af53169d66f22eab593c1df8836f75e5e827769
Sep 15 21:08:29.424317 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.424291    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e9121b_e2d0_40b2_ba46_ca5421f38eae.slice/crio-e1ca62e0916c8ce33604d63b8e3c004843abb45fbb428ba0236b73e3332c891f WatchSource:0}: Error finding container e1ca62e0916c8ce33604d63b8e3c004843abb45fbb428ba0236b73e3332c891f: Status 404 returned error can't find the container with id e1ca62e0916c8ce33604d63b8e3c004843abb45fbb428ba0236b73e3332c891f
Sep 15 21:08:29.424915 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.424894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbdbd1c_7999_4a61_aa40_65ac52349a93.slice/crio-5a32d971a1b952cb496b321b610eddea4286a2285f550073277bda185e0f2d41 WatchSource:0}: Error finding container 5a32d971a1b952cb496b321b610eddea4286a2285f550073277bda185e0f2d41: Status 404 returned error can't find the container with id 5a32d971a1b952cb496b321b610eddea4286a2285f550073277bda185e0f2d41
Sep 15 21:08:29.425748 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.425724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473d8145_d052_4ea7_9f03_db82c4c87f54.slice/crio-16779fc76521955cf2284a51e2506e9850ae71d32e976fe61673716876b5f788 WatchSource:0}: Error finding container 16779fc76521955cf2284a51e2506e9850ae71d32e976fe61673716876b5f788: Status 404 returned error can't find the container with id 16779fc76521955cf2284a51e2506e9850ae71d32e976fe61673716876b5f788
Sep 15 21:08:29.427186 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.427159    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe068b6_cc5f_4b7a_83ee_e24fdc88fb8b.slice/crio-13b38863f1d34c330b2a17ffeaf3531b0e30ca86c16c4173a26bf853c72ea1cb WatchSource:0}: Error finding container 13b38863f1d34c330b2a17ffeaf3531b0e30ca86c16c4173a26bf853c72ea1cb: Status 404 returned error can't find the container with id 13b38863f1d34c330b2a17ffeaf3531b0e30ca86c16c4173a26bf853c72ea1cb
Sep 15 21:08:29.428173 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.428149    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe471ec_cc51_4289_8517_1a03344f332e.slice/crio-d3966c95051174bc9b93217d85747ddcf315874a9771d7d17aa22e9253ccc21b WatchSource:0}: Error finding container d3966c95051174bc9b93217d85747ddcf315874a9771d7d17aa22e9253ccc21b: Status 404 returned error can't find the container with id d3966c95051174bc9b93217d85747ddcf315874a9771d7d17aa22e9253ccc21b
Sep 15 21:08:29.428886 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.428861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52acb764_0b0e_428c_967a_3ec871127556.slice/crio-f0e15409cca5310536ca562d43ab8c0339fe09bb9368b6d14ae1fad75ab8d46e WatchSource:0}: Error finding container f0e15409cca5310536ca562d43ab8c0339fe09bb9368b6d14ae1fad75ab8d46e: Status 404 returned error can't find the container with id f0e15409cca5310536ca562d43ab8c0339fe09bb9368b6d14ae1fad75ab8d46e
Sep 15 21:08:29.431574 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:08:29.431347    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d47377_618b_4b22_b2ac_db15aa42eac7.slice/crio-d4d5cdaca468adef742e6f30766733753fb13fef9d3305630dbb855070c797df WatchSource:0}: Error finding container d4d5cdaca468adef742e6f30766733753fb13fef9d3305630dbb855070c797df: Status 404 returned error can't find the container with id d4d5cdaca468adef742e6f30766733753fb13fef9d3305630dbb855070c797df
Sep 15 21:08:29.604440 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.604238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:29.604588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.604462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:29.604588 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604385    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:29.604588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:29.604511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:29.604588 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604566    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:31.604547649 +0000 UTC m=+6.008869688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604615    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604633    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604648    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604659    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604684    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:31.604666011 +0000 UTC m=+6.008988052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:29.604803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:29.604706    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:31.604695674 +0000 UTC m=+6.009017700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:30.033063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.032638    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:03:28 +0000 UTC" deadline="2028-06-13 18:27:27.497835764 +0000 UTC"
Sep 15 21:08:30.033063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.032700    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15285h18m57.465139754s"
Sep 15 21:08:30.078749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.078245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:30.078749 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:30.078395    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:30.078749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.078539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:30.078749 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:30.078641    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:30.090968 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.090922    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gvnl" event={"ID":"d5f6d62e-ae03-48c1-a87d-e0049652442b","Type":"ContainerStarted","Data":"94afd59529ce00c6388ceb4891dd79584d0856b65e148ec8310f68ca7f9d2aab"}
Sep 15 21:08:30.095499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.095461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" event={"ID":"d5fe63d2e1dec62eab5d7d2258fa34d2","Type":"ContainerStarted","Data":"5f66ef95f59450b1b9cb08149cb28ff8daf67cd3a4729244a6ec9ed349845463"}
Sep 15 21:08:30.100049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.100021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdwqw" event={"ID":"52acb764-0b0e-428c-967a-3ec871127556","Type":"ContainerStarted","Data":"f0e15409cca5310536ca562d43ab8c0339fe09bb9368b6d14ae1fad75ab8d46e"}
Sep 15 21:08:30.102151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.102122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzd2b" event={"ID":"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b","Type":"ContainerStarted","Data":"13b38863f1d34c330b2a17ffeaf3531b0e30ca86c16c4173a26bf853c72ea1cb"}
Sep 15 21:08:30.106768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.106742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2" event={"ID":"d1e9121b-e2d0-40b2-ba46-ca5421f38eae","Type":"ContainerStarted","Data":"e1ca62e0916c8ce33604d63b8e3c004843abb45fbb428ba0236b73e3332c891f"}
Sep 15 21:08:30.112006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.111977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55tj8" event={"ID":"095bf5ce-872e-4af2-8788-b244fddf4634","Type":"ContainerStarted","Data":"012b85f31dc9a388ff8b91e88af53169d66f22eab593c1df8836f75e5e827769"}
Sep 15 21:08:30.118892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.118859    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d9c349dff749c2683923cdd68686644" containerID="36781710f93d8fb17b68c2ccf17b799f982cc096130d9f23597c65853a1ea933" exitCode=0
Sep 15 21:08:30.119033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.118959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerDied","Data":"36781710f93d8fb17b68c2ccf17b799f982cc096130d9f23597c65853a1ea933"}
Sep 15 21:08:30.121284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.121259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerStarted","Data":"d4d5cdaca468adef742e6f30766733753fb13fef9d3305630dbb855070c797df"}
Sep 15 21:08:30.125885 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.125860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"d3966c95051174bc9b93217d85747ddcf315874a9771d7d17aa22e9253ccc21b"}
Sep 15 21:08:30.130200 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.130138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-czt5k" event={"ID":"473d8145-d052-4ea7-9f03-db82c4c87f54","Type":"ContainerStarted","Data":"16779fc76521955cf2284a51e2506e9850ae71d32e976fe61673716876b5f788"}
Sep 15 21:08:30.134716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.134644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77wsf" event={"ID":"4cbdbd1c-7999-4a61-aa40-65ac52349a93","Type":"ContainerStarted","Data":"5a32d971a1b952cb496b321b610eddea4286a2285f550073277bda185e0f2d41"}
Sep 15 21:08:30.138868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:30.138653    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" podStartSLOduration=3.138635003 podStartE2EDuration="3.138635003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:30.116823418 +0000 UTC m=+4.521145465" watchObservedRunningTime="2026-09-15 21:08:30.138635003 +0000 UTC m=+4.542957055"
Sep 15 21:08:31.075791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.075714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:31.076495 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.075836    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:31.150062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.150022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerStarted","Data":"dd7aa586fa42a82f1fcdfde2762272b65d8c930e50048aca83748d615cfee7da"}
Sep 15 21:08:31.172955 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.170278    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" podStartSLOduration=4.170259373 podStartE2EDuration="4.170259373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:31.168155798 +0000 UTC m=+5.572477846" watchObservedRunningTime="2026-09-15 21:08:31.170259373 +0000 UTC m=+5.574581421"
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.622965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.623021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:31.623082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623233    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623256    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623268    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623326    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:35.623307827 +0000 UTC m=+10.027629867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623737    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623787    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:35.623772067 +0000 UTC m=+10.028094117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623842    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:31.623914 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:31.623880    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:35.623868693 +0000 UTC m=+10.028190772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:32.079655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:32.078716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:32.079655 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:32.078847    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:32.079655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:32.079321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:32.079655 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:32.079426    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:33.076036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:33.076000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:33.076204 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:33.076136    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:34.076581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:34.075947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:34.076581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:34.076146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:34.076581 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:34.076230    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:34.076581 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:34.076085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:35.076469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:35.076382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:35.076641 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.076519    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:35.658156 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:35.658112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:35.658336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:35.658167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:35.658336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:35.658220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:35.658336 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658290    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:35.658336 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658321    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658339    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658364    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658377    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658377    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:43.658359979 +0000 UTC m=+18.062682004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658453    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:43.658417336 +0000 UTC m=+18.062739362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:35.658550 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:35.658472    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:43.65846447 +0000 UTC m=+18.062786496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:36.076645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:36.076553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:36.077094 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:36.076714    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:36.077094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:36.076561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:36.077094 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:36.077003    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:37.075708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:37.075670    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:37.075906 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:37.075816    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:38.076061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:38.075985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:38.076483 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:38.076144    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:38.076483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:38.076204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:38.076483 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:38.076325    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:39.076036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:39.076008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:39.076189 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:39.076105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:40.076122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:40.076083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:40.076337 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:40.076225    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:40.076688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:40.076388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:40.076688 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:40.076474    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:41.076204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:41.076167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:41.076384 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:41.076289    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:42.079428 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:42.079177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:42.079803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:42.079206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:42.079803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:42.079552    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:42.079803 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:42.079674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:43.076439 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:43.076403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:43.076675 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.076508    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:43.718600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:43.718559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:43.718631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:43.718664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718705    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718736    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718751    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718763    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718786    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718822    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:08:59.718801499 +0000 UTC m=+34.123123539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718840    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:08:59.718831201 +0000 UTC m=+34.123153232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:43.719034 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:43.718855    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:08:59.71884677 +0000 UTC m=+34.123168796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:44.079606 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:44.079497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:44.079758 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:44.079629    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:44.079758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:44.079689    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:44.079861 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:44.079822    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:45.076001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:45.075971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:45.076421 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:45.076091    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:46.076542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:46.076509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:46.077044 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:46.076653    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:46.077044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:46.076673    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:46.077044 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:46.076768    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:47.075713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:47.075677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:47.075885 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:47.075804    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:48.076344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.076144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:48.077057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.076189    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:48.077057 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:48.076451    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:48.077057 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:48.076530    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:48.191473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.191435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pdwqw" event={"ID":"52acb764-0b0e-428c-967a-3ec871127556","Type":"ContainerStarted","Data":"cf439a0b2e5988ad6f97545cf574fbd74a3d3f4609a031d4c968a8ae368cb53e"}
Sep 15 21:08:48.193175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.193146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzd2b" event={"ID":"3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b","Type":"ContainerStarted","Data":"dd1a14213e0b3558695365dfd67c3a0c0fe1aff4efb95843e47d44a26c1fcb81"}
Sep 15 21:08:48.194822 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.194797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2" event={"ID":"d1e9121b-e2d0-40b2-ba46-ca5421f38eae","Type":"ContainerStarted","Data":"4d1b6e15b75f794e308c2cb5fd6a86877cae5eed1fe3021f3f75bf42d425a91b"}
Sep 15 21:08:48.196695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.196668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55tj8" event={"ID":"095bf5ce-872e-4af2-8788-b244fddf4634","Type":"ContainerStarted","Data":"faf7ada7974b193e74ef2bc0cdfd8479d3f5d7f253f31e19dc70b0f1a15a93df"}
Sep 15 21:08:48.198521 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.198497    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="9e99eebf069c6d639f512e1e429725e7a873032324769a6ce49259e5583166d9" exitCode=0
Sep 15 21:08:48.198610 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.198582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"9e99eebf069c6d639f512e1e429725e7a873032324769a6ce49259e5583166d9"}
Sep 15 21:08:48.201741 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.201672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"8317dee11870c7157add7b121df38df806ceb885354ed5c0e96950294b59c85b"}
Sep 15 21:08:48.201792 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.201744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"b9e2de999f19aa9ff18d080162337e6848b46af72eda871fe134b66c991c4d4c"}
Sep 15 21:08:48.201826 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.201798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"8b6b3a377db0409b99db58bec6291af20e4a37b1ae7452d9fea9cf8c5530b050"}
Sep 15 21:08:48.204093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.204068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-czt5k" event={"ID":"473d8145-d052-4ea7-9f03-db82c4c87f54","Type":"ContainerStarted","Data":"8b005976e6932a8004984ccae718575b66e6c6e0eaeb28bde8aa7871d7c225e5"}
Sep 15 21:08:48.206052 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.206028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gvnl" event={"ID":"d5f6d62e-ae03-48c1-a87d-e0049652442b","Type":"ContainerStarted","Data":"d28dc8b19a8c699590940a4134093de8960f1666800e4ebb6a7e178d39928e87"}
Sep 15 21:08:48.210567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.210514    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pdwqw" podStartSLOduration=3.9762657790000002 podStartE2EDuration="22.210493444s" totalImagesPullingTime="18.234227665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:48.209715331 +0000 UTC m=+22.614037378" watchObservedRunningTime="2026-09-15 21:08:48.210493444 +0000 UTC m=+22.614815491"
Sep 15 21:08:48.224862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.224822    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-55tj8" podStartSLOduration=4.018532311 podStartE2EDuration="22.224806166s" totalImagesPullingTime="18.206273855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:48.224702141 +0000 UTC m=+22.629024187" watchObservedRunningTime="2026-09-15 21:08:48.224806166 +0000 UTC m=+22.629128213"
Sep 15 21:08:48.262911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.262864    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jzd2b" podStartSLOduration=4.003270797 podStartE2EDuration="22.262848112s" totalImagesPullingTime="18.259577315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:48.241646524 +0000 UTC m=+22.645968571" watchObservedRunningTime="2026-09-15 21:08:48.262848112 +0000 UTC m=+22.667170210"
Sep 15 21:08:48.280298 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.280239    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-czt5k" podStartSLOduration=3.781295416 podStartE2EDuration="22.280222268s" totalImagesPullingTime="18.498926852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:48.27990629 +0000 UTC m=+22.684228336" watchObservedRunningTime="2026-09-15 21:08:48.280222268 +0000 UTC m=+22.684544312"
Sep 15 21:08:48.298056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.298009    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9gvnl" podStartSLOduration=4.022196072 podStartE2EDuration="22.297991437s" totalImagesPullingTime="18.275795365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:48.297901594 +0000 UTC m=+22.702223641" watchObservedRunningTime="2026-09-15 21:08:48.297991437 +0000 UTC m=+22.702313466"
Sep 15 21:08:48.386628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.386595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:48.463165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:48.463081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:49.075828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:49.075748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:49.076019 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:49.075850    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:49.212310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:49.212269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"126cfa3186e58a8621481585960ebd488276b15d4eb06157df354b7e6cd23879"}
Sep 15 21:08:49.212879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:49.212340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"9d9a78691765a4920d7168a833a00a8e02762f32da034e5b5dac9fcc21ff5f78"}
Sep 15 21:08:49.212879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:49.212372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"011e8e6d14573f683e65c68b1d1b10e67c4a8cdc4c35970dfa41f86d9009125c"}
Sep 15 21:08:49.339601 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:49.339574    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 21:08:50.063116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.063006    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T21:08:49.339595778Z","UUID":"27d7657d-5b9d-4879-8262-b96d75e2f3a0","Handler":null,"Name":"","Endpoint":""}
Sep 15 21:08:50.064571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.064546    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 21:08:50.064714 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.064580    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 21:08:50.075890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.075860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:50.076070 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:50.075989    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:50.076070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.075860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:50.076186 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:50.076165    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:50.190554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.190525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:50.191210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.191190    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:50.216746 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.216706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2" event={"ID":"d1e9121b-e2d0-40b2-ba46-ca5421f38eae","Type":"ContainerStarted","Data":"dd9750a03cdc2a33f985f77cb4ce52fec0e27975c77c03d0b742b8d9fdd6e055"}
Sep 15 21:08:50.218517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.218480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77wsf" event={"ID":"4cbdbd1c-7999-4a61-aa40-65ac52349a93","Type":"ContainerStarted","Data":"e2fde0633801bf8ffdc8f2daae9f800d1184faf8c5a882a5f668cea934c29ba5"}
Sep 15 21:08:50.218856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.218756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:50.219188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.219174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9gvnl"
Sep 15 21:08:50.232545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.232498    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-77wsf" podStartSLOduration=5.965646838 podStartE2EDuration="24.232481201s" totalImagesPullingTime="18.266834363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:50.232293214 +0000 UTC m=+24.636615262" watchObservedRunningTime="2026-09-15 21:08:50.232481201 +0000 UTC m=+24.636803264"
Sep 15 21:08:50.299252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.299215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:50.399756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.399675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:50.499173 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:50.499136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:51.075716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:51.075626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:51.075929 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:51.075749    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:51.222833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:51.222786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2" event={"ID":"d1e9121b-e2d0-40b2-ba46-ca5421f38eae","Type":"ContainerStarted","Data":"b8658a0e40302851b4aba4f4b552e17936dc2f9706cb1564df32d8ef967a98a5"}
Sep 15 21:08:51.226248 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:51.226214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"7de14722ff5c7721bdaf5630b99c307b78a47f008d6c84115d28314574f8abbb"}
Sep 15 21:08:52.075974 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:52.075921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:52.076169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:52.075921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:52.076169 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:52.076085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:52.076279 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:52.076168    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:53.076179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:53.076084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:53.076741 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:53.076220    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:54.078929 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.078705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:54.079401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.078761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:54.079401 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:54.078962    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:54.079401 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:54.079061    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:54.233760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.233725    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="513db717997273ab570bef5edf4552365bc7e481cf0df494222a088b9145de1f" exitCode=0
Sep 15 21:08:54.233945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.233814    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"513db717997273ab570bef5edf4552365bc7e481cf0df494222a088b9145de1f"}
Sep 15 21:08:54.237700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.237674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" event={"ID":"ffe471ec-cc51-4289-8517-1a03344f332e","Type":"ContainerStarted","Data":"fc4b835a96308075acc158f1dd512525c24b0e6fd9c52b444b55f0ef3c9873d5"}
Sep 15 21:08:54.237990 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.237969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:54.238090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.238036    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:54.238090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.238077    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:54.252966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.252925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:54.253113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.253072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:08:54.254531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.254483    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5bt2" podStartSLOduration=7.478437171 podStartE2EDuration="28.254469228s" totalImagesPullingTime="20.776032057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:51.239681166 +0000 UTC m=+25.644003211" watchObservedRunningTime="2026-09-15 21:08:54.254469228 +0000 UTC m=+28.658791274"
Sep 15 21:08:54.280332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:54.280279    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz" podStartSLOduration=10.021179354 podStartE2EDuration="28.280265508s" totalImagesPullingTime="18.259086154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:08:54.279106702 +0000 UTC m=+28.683428749" watchObservedRunningTime="2026-09-15 21:08:54.280265508 +0000 UTC m=+28.684587553"
Sep 15 21:08:55.075674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.075601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:55.075806 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:55.075714    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:55.500695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.500469    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whzs8"]
Sep 15 21:08:55.501426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.500802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:55.501426 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:55.500917    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:55.501426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.501035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sps5"]
Sep 15 21:08:55.501426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.501124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:55.501426 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:55.501197    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:55.502267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.502244    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mv7mh"]
Sep 15 21:08:55.502370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:55.502357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:55.502499 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:55.502464    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:56.244249 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:56.244214    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="30f3aed04e641074a2696746a066b125d7463a9c67abfa0dcb9d1ff0de9eb918" exitCode=0
Sep 15 21:08:56.244395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:56.244315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"30f3aed04e641074a2696746a066b125d7463a9c67abfa0dcb9d1ff0de9eb918"}
Sep 15 21:08:57.075757 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:57.075721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:57.076212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:57.075832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:57.076212 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:57.075837    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:57.076212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:57.075859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:57.076212 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:57.075965    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:57.076212 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:57.076048    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:57.701190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:57.701146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:57.780355 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:57.780319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:08:58.251339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:58.251308    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="1aeac8bdaaaa9105ced3076208c8b55ae0dc3283ed17cbdfe333f39cf8a110a5" exitCode=0
Sep 15 21:08:58.251752 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:58.251383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"1aeac8bdaaaa9105ced3076208c8b55ae0dc3283ed17cbdfe333f39cf8a110a5"}
Sep 15 21:08:59.075491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.075453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:59.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.075459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:59.075694 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.075585    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sps5" podUID="fa798427-090b-45b1-89e4-1f85583f438d"
Sep 15 21:08:59.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.075459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:59.075694 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.075657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whzs8" podUID="07087042-afe2-4927-91f9-c18fe8fc2855"
Sep 15 21:08:59.075871 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.075718    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:08:59.732276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.732229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.732301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:08:59.732335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732410    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732426    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732436    2560 projected.go:196] Error preparing data for projected volume kube-api-access-tlb6p for pod openshift-network-diagnostics/network-check-target-whzs8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732490    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732505    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732497    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p podName:07087042-afe2-4927-91f9-c18fe8fc2855 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:31.732478779 +0000 UTC m=+66.136800827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlb6p" (UniqueName: "kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p") pod "network-check-target-whzs8" (UID: "07087042-afe2-4927-91f9-c18fe8fc2855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret podName:fa798427-090b-45b1-89e4-1f85583f438d nodeName:}" failed. No retries permitted until 2026-09-15 21:09:31.732554602 +0000 UTC m=+66.136876640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret") pod "global-pull-secret-syncer-2sps5" (UID: "fa798427-090b-45b1-89e4-1f85583f438d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:08:59.732881 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:08:59.732635    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:09:31.732607948 +0000 UTC m=+66.136929973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:09:00.429877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.429849    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeReady"
Sep 15 21:09:00.430060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.430003    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 21:09:00.475479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.475441    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zgtzk"]
Sep 15 21:09:00.492861 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.492825    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w9622"]
Sep 15 21:09:00.493053 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.492999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.495525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.495504    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 21:09:00.495525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.495524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5jgl\""
Sep 15 21:09:00.495712 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.495605    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 21:09:00.506325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.506303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgtzk"]
Sep 15 21:09:00.506450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.506337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9622"]
Sep 15 21:09:00.506450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.506426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.509348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.509320    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 21:09:00.509476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.509355    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 21:09:00.509539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.509500    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 21:09:00.509539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.509527    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lthts\""
Sep 15 21:09:00.602484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.602452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:00.639541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361ced3c-80ec-46da-b412-3f13aa982c46-tmp-dir\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.639685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/361ced3c-80ec-46da-b412-3f13aa982c46-config-volume\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.639685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.639778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08455511-d79f-4864-a164-e7609da524bd-cert\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.639865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxdg\" (UniqueName: \"kubernetes.io/projected/361ced3c-80ec-46da-b412-3f13aa982c46-kube-api-access-pfxdg\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.639865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.639796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq622\" (UniqueName: \"kubernetes.io/projected/08455511-d79f-4864-a164-e7609da524bd-kube-api-access-bq622\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.658318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.658284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:00.740456 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxdg\" (UniqueName: \"kubernetes.io/projected/361ced3c-80ec-46da-b412-3f13aa982c46-kube-api-access-pfxdg\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.740456 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq622\" (UniqueName: \"kubernetes.io/projected/08455511-d79f-4864-a164-e7609da524bd-kube-api-access-bq622\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.741045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361ced3c-80ec-46da-b412-3f13aa982c46-tmp-dir\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.741045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/361ced3c-80ec-46da-b412-3f13aa982c46-config-volume\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.741045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.741045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.740590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08455511-d79f-4864-a164-e7609da524bd-cert\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.741045 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:00.741012    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:00.741274 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:00.741090    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:01.241067596 +0000 UTC m=+35.645389634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:00.741345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.741296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/361ced3c-80ec-46da-b412-3f13aa982c46-config-volume\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.741531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.741508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/361ced3c-80ec-46da-b412-3f13aa982c46-tmp-dir\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.745525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.745500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08455511-d79f-4864-a164-e7609da524bd-cert\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.750291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.750263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxdg\" (UniqueName: \"kubernetes.io/projected/361ced3c-80ec-46da-b412-3f13aa982c46-kube-api-access-pfxdg\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:00.750522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.750500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq622\" (UniqueName: \"kubernetes.io/projected/08455511-d79f-4864-a164-e7609da524bd-kube-api-access-bq622\") pod \"ingress-canary-w9622\" (UID: \"08455511-d79f-4864-a164-e7609da524bd\") " pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:00.817457 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:00.817419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9622"
Sep 15 21:09:01.076360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.076127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:09:01.076542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.076157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:09:01.076542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.076157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:09:01.079571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.079549    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 21:09:01.080652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.080572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 21:09:01.080652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.080649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lj4g\""
Sep 15 21:09:01.080798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.080676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bkm5f\""
Sep 15 21:09:01.080798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.080682    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 21:09:01.080980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.080964    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 21:09:01.244740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.244662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:01.244899 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:01.244857    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:01.244967 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:01.244927    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:02.244907371 +0000 UTC m=+36.649229411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:01.849975 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.849920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:01.951315 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:01.951269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:02.196280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.196244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:02.253404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.253373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:02.253546 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:02.253501    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:02.253584 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:02.253567    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:04.253549799 +0000 UTC m=+38.657871823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:02.295892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.295862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:02.392233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.392205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:02.455376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.455299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9622"]
Sep 15 21:09:02.459472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:02.459437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:02.459809 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:09:02.459788    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08455511_d79f_4864_a164_e7609da524bd.slice/crio-f8f6d441ad077b544c271aca3ce628b2fa016c5d1a68867d5e3b4de89b452de5 WatchSource:0}: Error finding container f8f6d441ad077b544c271aca3ce628b2fa016c5d1a68867d5e3b4de89b452de5: Status 404 returned error can't find the container with id f8f6d441ad077b544c271aca3ce628b2fa016c5d1a68867d5e3b4de89b452de5
Sep 15 21:09:03.265260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:03.265225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9622" event={"ID":"08455511-d79f-4864-a164-e7609da524bd","Type":"ContainerStarted","Data":"f8f6d441ad077b544c271aca3ce628b2fa016c5d1a68867d5e3b4de89b452de5"}
Sep 15 21:09:03.268518 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:03.268489    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="18ae3d2e4e250d132ae4ada909e01f596d018ebee5a4b2e5dfdaddb5e2c19089" exitCode=0
Sep 15 21:09:03.268670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:03.268550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"18ae3d2e4e250d132ae4ada909e01f596d018ebee5a4b2e5dfdaddb5e2c19089"}
Sep 15 21:09:04.270456 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:04.270422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:04.271104 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:04.270598    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:04.271104 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:04.270657    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:08.270642697 +0000 UTC m=+42.674964721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:04.275109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:04.275082    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9d47377-618b-4b22-b2ac-db15aa42eac7" containerID="9d018425bd9a75140edbdd331d2dcf8c40992bec0823417333638e38efa772f5" exitCode=0
Sep 15 21:09:04.275224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:04.275131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerDied","Data":"9d018425bd9a75140edbdd331d2dcf8c40992bec0823417333638e38efa772f5"}
Sep 15 21:09:05.279376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.279286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9622" event={"ID":"08455511-d79f-4864-a164-e7609da524bd","Type":"ContainerStarted","Data":"224a7fa25eb7b5ac81466cecb57d4eadcc7b1e61d8dac11895e195d18e6b3719"}
Sep 15 21:09:05.282477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.282451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" event={"ID":"d9d47377-618b-4b22-b2ac-db15aa42eac7","Type":"ContainerStarted","Data":"f142a6c8e00c382f2db5a9b1b1c27c224829cdbdff7d8ab60f7ebdc8fa90c5f0"}
Sep 15 21:09:05.313646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.313592    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c8xpg" podStartSLOduration=9.356143303 podStartE2EDuration="39.313576248s" totalImagesPullingTime="29.957432945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:09:05.313097532 +0000 UTC m=+39.717419579" watchObservedRunningTime="2026-09-15 21:09:05.313576248 +0000 UTC m=+39.717898294"
Sep 15 21:09:05.314046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.314023    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w9622" podStartSLOduration=2.976327115 podStartE2EDuration="5.314013407s" totalImagesPullingTime="2.337686292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:09:05.294621261 +0000 UTC m=+39.698943320" watchObservedRunningTime="2026-09-15 21:09:05.314013407 +0000 UTC m=+39.718335474"
Sep 15 21:09:05.437145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.437110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:05.498724 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.498700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:05.953660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:05.953631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:08.298706 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:08.298667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:08.299110 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:08.298771    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:08.299110 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:08.298827    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:16.298814948 +0000 UTC m=+50.703136977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:12.348633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.348591    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"]
Sep 15 21:09:12.377541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.377509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"]
Sep 15 21:09:12.377692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.377610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.381611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.381576    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 21:09:12.381773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.381710    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 21:09:12.381773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.381724    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 21:09:12.381773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.381710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 21:09:12.381773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.381759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dsqf2\""
Sep 15 21:09:12.527983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.527926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd76768b-556b-4943-98df-ebb86fe42799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.528162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.528000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skp4f\" (UniqueName: \"kubernetes.io/projected/bd76768b-556b-4943-98df-ebb86fe42799-kube-api-access-skp4f\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.628344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.628270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd76768b-556b-4943-98df-ebb86fe42799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.628344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.628317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skp4f\" (UniqueName: \"kubernetes.io/projected/bd76768b-556b-4943-98df-ebb86fe42799-kube-api-access-skp4f\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.632054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.632030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd76768b-556b-4943-98df-ebb86fe42799-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.638864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.638841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skp4f\" (UniqueName: \"kubernetes.io/projected/bd76768b-556b-4943-98df-ebb86fe42799-kube-api-access-skp4f\") pod \"managed-serviceaccount-addon-agent-99cb994fb-2ttlp\" (UID: \"bd76768b-556b-4943-98df-ebb86fe42799\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.696392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.696358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"
Sep 15 21:09:12.982700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:12.982611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp"]
Sep 15 21:09:12.987158 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:09:12.987130    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd76768b_556b_4943_98df_ebb86fe42799.slice/crio-7662a3b4467405827652fd38ac12d3629fe96e294f505e6da8aa4a3794fac975 WatchSource:0}: Error finding container 7662a3b4467405827652fd38ac12d3629fe96e294f505e6da8aa4a3794fac975: Status 404 returned error can't find the container with id 7662a3b4467405827652fd38ac12d3629fe96e294f505e6da8aa4a3794fac975
Sep 15 21:09:13.302296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:13.302211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp" event={"ID":"bd76768b-556b-4943-98df-ebb86fe42799","Type":"ContainerStarted","Data":"7662a3b4467405827652fd38ac12d3629fe96e294f505e6da8aa4a3794fac975"}
Sep 15 21:09:16.311977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:16.311864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp" event={"ID":"bd76768b-556b-4943-98df-ebb86fe42799","Type":"ContainerStarted","Data":"7d3528e1301aa5b8091d2a62b119bdfe5a6be371b6458b7aa89a65437205d075"}
Sep 15 21:09:16.330769 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:16.330718    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp" podStartSLOduration=1.26915223 podStartE2EDuration="4.330702058s" totalImagesPullingTime="3.061549828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:09:16.329402727 +0000 UTC m=+50.733724774" watchObservedRunningTime="2026-09-15 21:09:16.330702058 +0000 UTC m=+50.735024103"
Sep 15 21:09:16.356791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:16.356750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:16.356956 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:16.356907    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:16.356995 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:16.356978    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:09:32.356963921 +0000 UTC m=+66.761285951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:23.175149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:23.175111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:23.402559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:23.402524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:26.254950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:26.254905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrpwz"
Sep 15 21:09:26.429995 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:26.429926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:26.519112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:26.518984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:09:31.767783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.767720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:09:31.767783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.767790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:09:31.768301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.767813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:09:31.770828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.770808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 21:09:31.770903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.770864    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 21:09:31.770951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.770899    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 21:09:31.778361 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:31.778339    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 21:09:31.778454 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:31.778431    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:10:35.778398486 +0000 UTC m=+130.182720526 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : secret "metrics-daemon-secret" not found
Sep 15 21:09:31.780438 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.780407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa798427-090b-45b1-89e4-1f85583f438d-original-pull-secret\") pod \"global-pull-secret-syncer-2sps5\" (UID: \"fa798427-090b-45b1-89e4-1f85583f438d\") " pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:09:31.781631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.781616    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 21:09:31.791394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.791372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlb6p\" (UniqueName: \"kubernetes.io/projected/07087042-afe2-4927-91f9-c18fe8fc2855-kube-api-access-tlb6p\") pod \"network-check-target-whzs8\" (UID: \"07087042-afe2-4927-91f9-c18fe8fc2855\") " pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:09:31.988830 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.988776    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sps5"
Sep 15 21:09:31.999123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:31.999094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bkm5f\""
Sep 15 21:09:32.006515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.006491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:09:32.265865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.265833    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sps5"]
Sep 15 21:09:32.269154 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:09:32.269123    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa798427_090b_45b1_89e4_1f85583f438d.slice/crio-c3cb31b9c752900abd139d92a2e4f90f91ef44fd721574728773d6332ef03bb2 WatchSource:0}: Error finding container c3cb31b9c752900abd139d92a2e4f90f91ef44fd721574728773d6332ef03bb2: Status 404 returned error can't find the container with id c3cb31b9c752900abd139d92a2e4f90f91ef44fd721574728773d6332ef03bb2
Sep 15 21:09:32.289147 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.289066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whzs8"]
Sep 15 21:09:32.292170 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:09:32.292142    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07087042_afe2_4927_91f9_c18fe8fc2855.slice/crio-684b1869488400744de95d97d5e908eaef0398e7f1048be30de41cb70525df8f WatchSource:0}: Error finding container 684b1869488400744de95d97d5e908eaef0398e7f1048be30de41cb70525df8f: Status 404 returned error can't find the container with id 684b1869488400744de95d97d5e908eaef0398e7f1048be30de41cb70525df8f
Sep 15 21:09:32.349631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.349587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sps5" event={"ID":"fa798427-090b-45b1-89e4-1f85583f438d","Type":"ContainerStarted","Data":"c3cb31b9c752900abd139d92a2e4f90f91ef44fd721574728773d6332ef03bb2"}
Sep 15 21:09:32.350774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.350743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whzs8" event={"ID":"07087042-afe2-4927-91f9-c18fe8fc2855","Type":"ContainerStarted","Data":"684b1869488400744de95d97d5e908eaef0398e7f1048be30de41cb70525df8f"}
Sep 15 21:09:32.371184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:32.371152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:09:32.371304 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:32.371257    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:09:32.371346 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:09:32.371308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:04.371295325 +0000 UTC m=+98.775617349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:09:37.365872 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:37.365826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sps5" event={"ID":"fa798427-090b-45b1-89e4-1f85583f438d","Type":"ContainerStarted","Data":"4f5157291c6ea08148f4ae7d2ae6f2cc30ac32ba566588a5f75758987baa84d6"}
Sep 15 21:09:37.367386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:37.367362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whzs8" event={"ID":"07087042-afe2-4927-91f9-c18fe8fc2855","Type":"ContainerStarted","Data":"8320d76727771b68c90ff9ef4073307b3719c65feb8e2433197d775ddceb06f6"}
Sep 15 21:09:37.367511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:37.367500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:09:37.385721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:37.385664    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2sps5" podStartSLOduration=66.96638424 podStartE2EDuration="1m11.385650583s" totalImagesPullingTime="4.419266343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:09:37.385334469 +0000 UTC m=+71.789656519" watchObservedRunningTime="2026-09-15 21:09:37.385650583 +0000 UTC m=+71.789972653"
Sep 15 21:09:37.405044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:09:37.404986    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-whzs8" podStartSLOduration=67.018838602 podStartE2EDuration="1m11.404969467s" totalImagesPullingTime="4.386130865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:09:37.404555305 +0000 UTC m=+71.808877353" watchObservedRunningTime="2026-09-15 21:09:37.404969467 +0000 UTC m=+71.809291513"
Sep 15 21:10:04.379753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:10:04.379703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:10:04.380266 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:10:04.379836    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:04.380266 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:10:04.379898    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:08.379884539 +0000 UTC m=+162.784206568 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:08.372267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:10:08.372232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-whzs8"
Sep 15 21:10:35.797734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:10:35.797684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:10:35.798250 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:10:35.797839    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 21:10:35.798250 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:10:35.797905    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs podName:be174629-7667-4599-b792-257633f812fa nodeName:}" failed. No retries permitted until 2026-09-15 21:12:37.797887092 +0000 UTC m=+252.202209117 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs") pod "network-metrics-daemon-mv7mh" (UID: "be174629-7667-4599-b792-257633f812fa") : secret "metrics-daemon-secret" not found
Sep 15 21:11:03.505420 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:11:03.505368    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zgtzk" podUID="361ced3c-80ec-46da-b412-3f13aa982c46"
Sep 15 21:11:03.573997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:03.573968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:11:04.101384 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:11:04.101323    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mv7mh" podUID="be174629-7667-4599-b792-257633f812fa"
Sep 15 21:11:04.851089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:04.851056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:08.422742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:08.422689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:11:08.423398 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:11:08.422831    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:11:08.423398 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:11:08.422920    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls podName:361ced3c-80ec-46da-b412-3f13aa982c46 nodeName:}" failed. No retries permitted until 2026-09-15 21:13:10.422897135 +0000 UTC m=+284.827219162 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls") pod "dns-default-zgtzk" (UID: "361ced3c-80ec-46da-b412-3f13aa982c46") : secret "dns-default-metrics-tls" not found
Sep 15 21:11:16.607246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:16.607209    2560 generic.go:356] "Generic (PLEG): container finished" podID="bd76768b-556b-4943-98df-ebb86fe42799" containerID="7d3528e1301aa5b8091d2a62b119bdfe5a6be371b6458b7aa89a65437205d075" exitCode=255
Sep 15 21:11:16.607606 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:16.607269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp" event={"ID":"bd76768b-556b-4943-98df-ebb86fe42799","Type":"ContainerDied","Data":"7d3528e1301aa5b8091d2a62b119bdfe5a6be371b6458b7aa89a65437205d075"}
Sep 15 21:11:16.612710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:16.612683    2560 scope.go:117] "RemoveContainer" containerID="7d3528e1301aa5b8091d2a62b119bdfe5a6be371b6458b7aa89a65437205d075"
Sep 15 21:11:17.611507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:17.611470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-99cb994fb-2ttlp" event={"ID":"bd76768b-556b-4943-98df-ebb86fe42799","Type":"ContainerStarted","Data":"c14ee662f065f842c84c29aa590062c3c653bb053c77b862b879b4669a4f595f"}
Sep 15 21:11:18.076363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:18.076251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:11:36.996012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:11:36.995974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:18.709149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.709105    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9c7c9d6-qrjlt"]
Sep 15 21:12:18.710916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.710897    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:12:18.711041 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.711019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.713021 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.712992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.713838 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.713815    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 21:12:18.714081 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.713919    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 21:12:18.714549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.714457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lclz2\""
Sep 15 21:12:18.714549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.714538    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 21:12:18.714875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.714855    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 21:12:18.715992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.715965    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 21:12:18.717029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.717007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hkpc\""
Sep 15 21:12:18.717327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.717304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 21:12:18.717416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.717364    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 21:12:18.717476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.717307    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 21:12:18.721303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.721281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 21:12:18.721859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.721842    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 21:12:18.728525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.728497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9c7c9d6-qrjlt"]
Sep 15 21:12:18.734546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.734509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:12:18.800458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.800422    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"]
Sep 15 21:12:18.801361 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-default-certificate\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.801425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801462 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801462 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.801603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-stats-auth\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.801696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.801696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkhx\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.801802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.801751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh6bx\" (UniqueName: \"kubernetes.io/projected/00a6e246-d23d-403c-91bf-9f7b649e7930-kube-api-access-dh6bx\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.802393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.802380    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-lhfh5"]
Sep 15 21:12:18.802512 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.802499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:18.804476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.804457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.805783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.805764    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 21:12:18.806075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.806060    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zfpdd\""
Sep 15 21:12:18.806177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.806115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:12:18.806473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.806454    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 21:12:18.806542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.806488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 21:12:18.806745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.806728    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8sv47\""
Sep 15 21:12:18.807529 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.807513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 21:12:18.807605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.807547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 21:12:18.807605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.807595    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 21:12:18.808317 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.808300    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 21:12:18.814763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.814730    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 21:12:18.815237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.815213    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"]
Sep 15 21:12:18.816234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.816211    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lhfh5"]
Sep 15 21:12:18.894284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.894250    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-sl8vh"]
Sep 15 21:12:18.896224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.896207    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:18.898382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.898352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:18.899357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.899340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 15 21:12:18.899524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.899506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 15 21:12:18.899580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.899516    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 15 21:12:18.899798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.899782    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wg6q6\""
Sep 15 21:12:18.899917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.899899    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:12:18.902112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.902234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.902234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-serving-cert\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:18.902234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br69n\" (UniqueName: \"kubernetes.io/projected/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-kube-api-access-br69n\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.902245    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:19.402223983 +0000 UTC m=+233.806546028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : configmap references non-existent config key: service-ca.crt
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6bx\" (UniqueName: \"kubernetes.io/projected/00a6e246-d23d-403c-91bf-9f7b649e7930-kube-api-access-dh6bx\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.902296    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-service-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-tmp\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.902452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-stats-auth\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkhx\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-config\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-snapshots\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-default-certificate\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mpb5\" (UniqueName: \"kubernetes.io/projected/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-kube-api-access-8mpb5\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.902734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.902960 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.902872    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:19.402849375 +0000 UTC m=+233.807171407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : secret "router-metrics-certs-default" not found
Sep 15 21:12:18.903621 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.903344    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:12:18.903621 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.903358    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b5df7cd-b7x2z: secret "image-registry-tls" not found
Sep 15 21:12:18.903621 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.903382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.903621 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:18.903404    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls podName:f8f5153c-d823-49d9-901e-02c8cf81859a nodeName:}" failed. No retries permitted until 2026-09-15 21:12:19.403387475 +0000 UTC m=+233.807709514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls") pod "image-registry-844b5df7cd-b7x2z" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a") : secret "image-registry-tls" not found
Sep 15 21:12:18.903621 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.903552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-serving-cert\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:18.903864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.903765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.904451 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.904421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.904815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.904782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.905390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.905359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.905539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.905512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-stats-auth\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.905930 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.905865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-default-certificate\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.906329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.906307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.906855 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.906593    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 15 21:12:18.907470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.907452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-sl8vh"]
Sep 15 21:12:18.914908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.914882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6bx\" (UniqueName: \"kubernetes.io/projected/00a6e246-d23d-403c-91bf-9f7b649e7930-kube-api-access-dh6bx\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:18.918001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.917979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkhx\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.918001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.917983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:18.998327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:18.998224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:19.004811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.004762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-config\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.005049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-snapshots\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005216 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mpb5\" (UniqueName: \"kubernetes.io/projected/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-kube-api-access-8mpb5\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-config\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.005484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/379493e1-5577-4f36-bb77-89dbc4f8d352-serving-cert\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.005532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-serving-cert\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-trusted-ca\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.005636 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-serving-cert\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.005686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br69n\" (UniqueName: \"kubernetes.io/projected/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-kube-api-access-br69n\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.005686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-config\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.005772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-service-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-tmp\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.005859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4hl\" (UniqueName: \"kubernetes.io/projected/379493e1-5577-4f36-bb77-89dbc4f8d352-kube-api-access-5s4hl\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.005982 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.005958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-snapshots\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.006778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.006750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.007248 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.007221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-service-ca-bundle\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.008811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.008785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-serving-cert\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.010029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.010006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-serving-cert\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.010109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.010011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-tmp\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.014338 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.014307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br69n\" (UniqueName: \"kubernetes.io/projected/05c1e1dd-cf30-4c90-85e6-6a07b01e1d70-kube-api-access-br69n\") pod \"service-ca-operator-cf7c776b7-pwhl4\" (UID: \"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.014743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.014724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mpb5\" (UniqueName: \"kubernetes.io/projected/deb8d311-ea1d-4355-97b5-4d50b7bb9d36-kube-api-access-8mpb5\") pod \"insights-operator-5844b856db-lhfh5\" (UID: \"deb8d311-ea1d-4355-97b5-4d50b7bb9d36\") " pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.098568 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.098531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:19.106699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.106666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-trusted-ca\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.106783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.106705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-config\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.106884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.106841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4hl\" (UniqueName: \"kubernetes.io/projected/379493e1-5577-4f36-bb77-89dbc4f8d352-kube-api-access-5s4hl\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.107028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.106954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/379493e1-5577-4f36-bb77-89dbc4f8d352-serving-cert\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.107404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.107383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-config\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.107484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.107474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/379493e1-5577-4f36-bb77-89dbc4f8d352-trusted-ca\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.109255 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.109237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/379493e1-5577-4f36-bb77-89dbc4f8d352-serving-cert\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.113206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.113188    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"
Sep 15 21:12:19.115433 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.115413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4hl\" (UniqueName: \"kubernetes.io/projected/379493e1-5577-4f36-bb77-89dbc4f8d352-kube-api-access-5s4hl\") pod \"console-operator-696884fb9c-sl8vh\" (UID: \"379493e1-5577-4f36-bb77-89dbc4f8d352\") " pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.119778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.119758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lhfh5"
Sep 15 21:12:19.206396 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.206362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:19.383028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.382989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4"]
Sep 15 21:12:19.385850 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:19.385817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c1e1dd_cf30_4c90_85e6_6a07b01e1d70.slice/crio-caf128388e3dc60460473295338f1208fc48c4a9011aa99e1e50783e7277065a WatchSource:0}: Error finding container caf128388e3dc60460473295338f1208fc48c4a9011aa99e1e50783e7277065a: Status 404 returned error can't find the container with id caf128388e3dc60460473295338f1208fc48c4a9011aa99e1e50783e7277065a
Sep 15 21:12:19.393045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.393016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lhfh5"]
Sep 15 21:12:19.395903 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:19.395876    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb8d311_ea1d_4355_97b5_4d50b7bb9d36.slice/crio-128313e8f42f6da7a5b2bd40c493b90dac228efb2971fb8beb05d951e503e39c WatchSource:0}: Error finding container 128313e8f42f6da7a5b2bd40c493b90dac228efb2971fb8beb05d951e503e39c: Status 404 returned error can't find the container with id 128313e8f42f6da7a5b2bd40c493b90dac228efb2971fb8beb05d951e503e39c
Sep 15 21:12:19.409583 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.409544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:19.409732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.409604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:19.409732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.409631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:19.409732 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409724    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:12:19.409864 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409742    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b5df7cd-b7x2z: secret "image-registry-tls" not found
Sep 15 21:12:19.409864 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409744    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 21:12:19.409864 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409798    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:20.409783461 +0000 UTC m=+234.814105485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : secret "router-metrics-certs-default" not found
Sep 15 21:12:19.409864 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409817    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls podName:f8f5153c-d823-49d9-901e-02c8cf81859a nodeName:}" failed. No retries permitted until 2026-09-15 21:12:20.409807702 +0000 UTC m=+234.814129729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls") pod "image-registry-844b5df7cd-b7x2z" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a") : secret "image-registry-tls" not found
Sep 15 21:12:19.409864 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:19.409836    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:20.409827099 +0000 UTC m=+234.814149125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : configmap references non-existent config key: service-ca.crt
Sep 15 21:12:19.482133 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.482078    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-sl8vh"]
Sep 15 21:12:19.484921 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:19.484895    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379493e1_5577_4f36_bb77_89dbc4f8d352.slice/crio-5d041bb4d35ba78a4bf43746f8a7997a4dae0e9fc41efdab2ba05926b3188f93 WatchSource:0}: Error finding container 5d041bb4d35ba78a4bf43746f8a7997a4dae0e9fc41efdab2ba05926b3188f93: Status 404 returned error can't find the container with id 5d041bb4d35ba78a4bf43746f8a7997a4dae0e9fc41efdab2ba05926b3188f93
Sep 15 21:12:19.761646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.761605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" event={"ID":"379493e1-5577-4f36-bb77-89dbc4f8d352","Type":"ContainerStarted","Data":"5d041bb4d35ba78a4bf43746f8a7997a4dae0e9fc41efdab2ba05926b3188f93"}
Sep 15 21:12:19.762616 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.762593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lhfh5" event={"ID":"deb8d311-ea1d-4355-97b5-4d50b7bb9d36","Type":"ContainerStarted","Data":"128313e8f42f6da7a5b2bd40c493b90dac228efb2971fb8beb05d951e503e39c"}
Sep 15 21:12:19.763539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:19.763520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4" event={"ID":"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70","Type":"ContainerStarted","Data":"caf128388e3dc60460473295338f1208fc48c4a9011aa99e1e50783e7277065a"}
Sep 15 21:12:20.416393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:20.416352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:20.416609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:20.416407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:20.416609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:20.416496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:20.416609 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416546    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:22.416521526 +0000 UTC m=+236.820843556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : configmap references non-existent config key: service-ca.crt
Sep 15 21:12:20.416797 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416615    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:12:20.416797 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416630    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b5df7cd-b7x2z: secret "image-registry-tls" not found
Sep 15 21:12:20.416797 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416678    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls podName:f8f5153c-d823-49d9-901e-02c8cf81859a nodeName:}" failed. No retries permitted until 2026-09-15 21:12:22.416662788 +0000 UTC m=+236.820984821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls") pod "image-registry-844b5df7cd-b7x2z" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a") : secret "image-registry-tls" not found
Sep 15 21:12:20.416797 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416751    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 21:12:20.416797 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:20.416787    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:22.416776815 +0000 UTC m=+236.821098847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : secret "router-metrics-certs-default" not found
Sep 15 21:12:20.771050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:20.770958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:20.869635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:20.869599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:22.434790 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.434761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.434798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.434882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.434914    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:26.434896485 +0000 UTC m=+240.839218513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : configmap references non-existent config key: service-ca.crt
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.435004    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.435060    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.435072    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:26.435054696 +0000 UTC m=+240.839376740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : secret "router-metrics-certs-default" not found
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.435078    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b5df7cd-b7x2z: secret "image-registry-tls" not found
Sep 15 21:12:22.435151 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:22.435114    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls podName:f8f5153c-d823-49d9-901e-02c8cf81859a nodeName:}" failed. No retries permitted until 2026-09-15 21:12:26.435102648 +0000 UTC m=+240.839424673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls") pod "image-registry-844b5df7cd-b7x2z" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a") : secret "image-registry-tls" not found
Sep 15 21:12:22.775581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.775502    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/0.log"
Sep 15 21:12:22.775581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.775541    2560 generic.go:356] "Generic (PLEG): container finished" podID="379493e1-5577-4f36-bb77-89dbc4f8d352" containerID="d9c0cefe8d802041d02adffed51043322ac0c8af2bb28812af36f3422d30f4f1" exitCode=255
Sep 15 21:12:22.775789 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.775627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" event={"ID":"379493e1-5577-4f36-bb77-89dbc4f8d352","Type":"ContainerDied","Data":"d9c0cefe8d802041d02adffed51043322ac0c8af2bb28812af36f3422d30f4f1"}
Sep 15 21:12:22.775897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.775871    2560 scope.go:117] "RemoveContainer" containerID="d9c0cefe8d802041d02adffed51043322ac0c8af2bb28812af36f3422d30f4f1"
Sep 15 21:12:22.777481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.777448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lhfh5" event={"ID":"deb8d311-ea1d-4355-97b5-4d50b7bb9d36","Type":"ContainerStarted","Data":"ee80f0f809076e1a9c231ad31f833a890042822c2714039b565d8f89729f58ed"}
Sep 15 21:12:22.779333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.779309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4" event={"ID":"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70","Type":"ContainerStarted","Data":"d409c736bfcf4ad5a22b11e1a52effb9b459d7caf44c8919db6a4e6185643856"}
Sep 15 21:12:22.813182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.813129    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4" podStartSLOduration=1.770416455 podStartE2EDuration="4.813107046s" totalImagesPullingTime="3.042690591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:22.812299761 +0000 UTC m=+237.216621807" watchObservedRunningTime="2026-09-15 21:12:22.813107046 +0000 UTC m=+237.217429092"
Sep 15 21:12:22.836278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.836203    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-lhfh5" podStartSLOduration=1.8130355420000002 podStartE2EDuration="4.836182092s" totalImagesPullingTime="3.02314655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:22.835314426 +0000 UTC m=+237.239636474" watchObservedRunningTime="2026-09-15 21:12:22.836182092 +0000 UTC m=+237.240504142"
Sep 15 21:12:22.982614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:22.982574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.077733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.077646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.143756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.143723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.536827 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.536789    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hn7xp"]
Sep 15 21:12:23.539207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.539181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.541600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.541569    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 21:12:23.541747 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.541660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8r4hc\""
Sep 15 21:12:23.541798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.541786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 21:12:23.551676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.551646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hn7xp"]
Sep 15 21:12:23.559797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.559772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.619267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.619231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.645656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.645613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.645656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.645656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade8a6ca-4529-4353-a7e9-5648e2199793-data-volume\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.645850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.645722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ade8a6ca-4529-4353-a7e9-5648e2199793-crio-socket\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.645850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.645746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.645850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.645765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zhxs\" (UniqueName: \"kubernetes.io/projected/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-api-access-8zhxs\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.696756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.696674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:23.746908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.746864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ade8a6ca-4529-4353-a7e9-5648e2199793-crio-socket\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.746908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.746915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.746967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zhxs\" (UniqueName: \"kubernetes.io/projected/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-api-access-8zhxs\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.747014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ade8a6ca-4529-4353-a7e9-5648e2199793-crio-socket\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.747079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.747113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade8a6ca-4529-4353-a7e9-5648e2199793-data-volume\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747297 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:23.747197    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:12:23.747297 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:23.747249    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:24.247232544 +0000 UTC m=+238.651554568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : configmap "kube-rbac-proxy" not found
Sep 15 21:12:23.747409 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:23.747393    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:23.747453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.747421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade8a6ca-4529-4353-a7e9-5648e2199793-data-volume\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.747453 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:23.747450    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:24.247437293 +0000 UTC m=+238.651759322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:23.755478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.755454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zhxs\" (UniqueName: \"kubernetes.io/projected/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-api-access-8zhxs\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:23.783819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.783788    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/1.log"
Sep 15 21:12:23.784277 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.784262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/0.log"
Sep 15 21:12:23.784342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.784296    2560 generic.go:356] "Generic (PLEG): container finished" podID="379493e1-5577-4f36-bb77-89dbc4f8d352" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a" exitCode=255
Sep 15 21:12:23.784342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.784328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" event={"ID":"379493e1-5577-4f36-bb77-89dbc4f8d352","Type":"ContainerDied","Data":"5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"}
Sep 15 21:12:23.784421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.784392    2560 scope.go:117] "RemoveContainer" containerID="d9c0cefe8d802041d02adffed51043322ac0c8af2bb28812af36f3422d30f4f1"
Sep 15 21:12:23.784654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:23.784636    2560 scope.go:117] "RemoveContainer" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"
Sep 15 21:12:23.784851 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:23.784829    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:12:24.252670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.252632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:24.252988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.252708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:24.252988 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:24.252775    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:12:24.252988 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:24.252821    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:24.252988 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:24.252859    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:25.252836284 +0000 UTC m=+239.657158309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : configmap "kube-rbac-proxy" not found
Sep 15 21:12:24.252988 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:24.252882    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:25.252872197 +0000 UTC m=+239.657194221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:24.649043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.649008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:24.723809 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.723779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:24.789683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.789656    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/1.log"
Sep 15 21:12:24.790043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:24.790027    2560 scope.go:117] "RemoveContainer" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"
Sep 15 21:12:24.790195 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:24.790176    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:12:25.261204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.261162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:25.261388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.261238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:25.261388 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:25.261284    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:12:25.261388 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:25.261335    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:25.261388 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:25.261354    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:27.261337232 +0000 UTC m=+241.665659261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : configmap "kube-rbac-proxy" not found
Sep 15 21:12:25.261388 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:25.261374    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:27.261363076 +0000 UTC m=+241.665685106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:25.786271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.786218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:25.856917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.856879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:25.967230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.967193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8s44w"]
Sep 15 21:12:25.970057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.970033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:25.972979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.972956    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 21:12:25.973115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.972956    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 21:12:25.974142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.974115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pfx2l\""
Sep 15 21:12:25.974258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.974120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 21:12:25.974401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.974385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 21:12:25.978515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:25.978490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8s44w"]
Sep 15 21:12:26.012369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.012338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:26.067562 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.067481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-key\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.067693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.067586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5z84\" (UniqueName: \"kubernetes.io/projected/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-kube-api-access-w5z84\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.067693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.067636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-cabundle\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.168242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.168174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5z84\" (UniqueName: \"kubernetes.io/projected/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-kube-api-access-w5z84\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.168455 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.168278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-cabundle\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.168455 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.168347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-key\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.169025 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.168992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-cabundle\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.170880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.170845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-signing-key\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.183222 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.183186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5z84\" (UniqueName: \"kubernetes.io/projected/f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6-kube-api-access-w5z84\") pod \"service-ca-568869fdc5-8s44w\" (UID: \"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6\") " pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.209930 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.209903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzd2b_3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b/dns-node-resolver/0.log"
Sep 15 21:12:26.280143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.280113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-8s44w"
Sep 15 21:12:26.471489 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.471445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.471506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.471524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471601    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471631    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b5df7cd-b7x2z: secret "image-registry-tls" not found
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471606    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 21:12:26.471686 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471687    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:34.471673713 +0000 UTC m=+248.875995742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : secret "router-metrics-certs-default" not found
Sep 15 21:12:26.471892 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471700    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls podName:f8f5153c-d823-49d9-901e-02c8cf81859a nodeName:}" failed. No retries permitted until 2026-09-15 21:12:34.471694551 +0000 UTC m=+248.876016576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls") pod "image-registry-844b5df7cd-b7x2z" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a") : secret "image-registry-tls" not found
Sep 15 21:12:26.471892 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:26.471711    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle podName:00a6e246-d23d-403c-91bf-9f7b649e7930 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:34.471706362 +0000 UTC m=+248.876028387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle") pod "router-default-9c7c9d6-qrjlt" (UID: "00a6e246-d23d-403c-91bf-9f7b649e7930") : configmap references non-existent config key: service-ca.crt
Sep 15 21:12:26.551865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.551829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8s44w"]
Sep 15 21:12:26.555882 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:26.555853    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a79f2b_d6fa_4dd2_b1f1_c1e72b0dd6e6.slice/crio-b5f8bada0ac1cc382a7fed286ffbffefeae6db932548f06a61433ce88d5ab9c4 WatchSource:0}: Error finding container b5f8bada0ac1cc382a7fed286ffbffefeae6db932548f06a61433ce88d5ab9c4: Status 404 returned error can't find the container with id b5f8bada0ac1cc382a7fed286ffbffefeae6db932548f06a61433ce88d5ab9c4
Sep 15 21:12:26.742044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.742003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:26.797569 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.797535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-8s44w" event={"ID":"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6","Type":"ContainerStarted","Data":"39b7f2d84c3f87d9bf2d5963e7e470c7823f8bbdf25684c05223ad3f66a8e0d5"}
Sep 15 21:12:26.798043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.797590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-8s44w" event={"ID":"f1a79f2b-d6fa-4dd2-b1f1-c1e72b0dd6e6","Type":"ContainerStarted","Data":"b5f8bada0ac1cc382a7fed286ffbffefeae6db932548f06a61433ce88d5ab9c4"}
Sep 15 21:12:26.817759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:26.817703    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-8s44w" podStartSLOduration=1.8176864780000002 podStartE2EDuration="1.817686478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:26.817471836 +0000 UTC m=+241.221793882" watchObservedRunningTime="2026-09-15 21:12:26.817686478 +0000 UTC m=+241.222008525"
Sep 15 21:12:27.065876 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:27.065816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:27.195710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:27.195681    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55tj8_095bf5ce-872e-4af2-8788-b244fddf4634/node-ca/0.log"
Sep 15 21:12:27.279353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:27.279310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:27.279551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:27.279403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:27.279551 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:27.279435    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:12:27.279551 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:27.279499    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:31.279483616 +0000 UTC m=+245.683805646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : configmap "kube-rbac-proxy" not found
Sep 15 21:12:27.279551 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:27.279523    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:27.279716 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:27.279572    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:31.279556914 +0000 UTC m=+245.683878939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:28.023684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.023645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.146166 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.146122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.275756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.275671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.381554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.381512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.395713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.395682    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9622_08455511-d79f-4864-a164-e7609da524bd/serve-healthcheck-canary/0.log"
Sep 15 21:12:28.484044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.484008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.619136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.619099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.723829 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:28.723793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:29.206848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:29.206803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:29.207279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:29.206873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:29.207279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:29.207234    2560 scope.go:117] "RemoveContainer" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"
Sep 15 21:12:29.207409 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:29.207389    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:12:29.926540 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:29.926503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:30.108102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:30.108069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:30.207359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:30.207266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:30.328260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:30.328226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:30.516212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:30.516125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:30.728912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:30.728868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.319080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.319045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:31.319572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.319147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:31.319572 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:31.319203    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:31.319572 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:31.319261    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:12:31.319572 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:31.319264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:39.319247992 +0000 UTC m=+253.723570017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:31.319572 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:31.319313    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm podName:ade8a6ca-4529-4353-a7e9-5648e2199793 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:39.319302448 +0000 UTC m=+253.723624476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hn7xp" (UID: "ade8a6ca-4529-4353-a7e9-5648e2199793") : configmap "kube-rbac-proxy" not found
Sep 15 21:12:31.576633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.576540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.681763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.681733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.778486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.778445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.921651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:31.921616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:32.320713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:32.320604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:32.917426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:32.917392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.119250 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:33.119215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.310402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:33.310323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.711477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:33.711413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:34.322266 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.322234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:34.504098 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.504064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:34.548015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.547970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:34.548172 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.548050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:34.548172 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.548078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:34.548697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.548666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a6e246-d23d-403c-91bf-9f7b649e7930-service-ca-bundle\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:34.550443 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.550411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a6e246-d23d-403c-91bf-9f7b649e7930-metrics-certs\") pod \"router-default-9c7c9d6-qrjlt\" (UID: \"00a6e246-d23d-403c-91bf-9f7b649e7930\") " pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:34.550539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.550460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"image-registry-844b5df7cd-b7x2z\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") " pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:34.625018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.624983    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lclz2\""
Sep 15 21:12:34.630062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.630038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hkpc\""
Sep 15 21:12:34.633048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.633030    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:34.638728 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.638704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:34.717411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.717357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:34.913224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.913143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9c7c9d6-qrjlt"]
Sep 15 21:12:34.917388 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:34.917361    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a6e246_d23d_403c_91bf_9f7b649e7930.slice/crio-448a6c4fbe522907d5e418d850945847117bb4154d00f2fb06cc945bcf508bfb WatchSource:0}: Error finding container 448a6c4fbe522907d5e418d850945847117bb4154d00f2fb06cc945bcf508bfb: Status 404 returned error can't find the container with id 448a6c4fbe522907d5e418d850945847117bb4154d00f2fb06cc945bcf508bfb
Sep 15 21:12:34.917604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:34.917581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:12:34.920415 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:34.920383    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f5153c_d823_49d9_901e_02c8cf81859a.slice/crio-5fcb106399ea3db0f4bb7fe2ad2412519852c5694f2e89ec567c6d2315c07ab9 WatchSource:0}: Error finding container 5fcb106399ea3db0f4bb7fe2ad2412519852c5694f2e89ec567c6d2315c07ab9: Status 404 returned error can't find the container with id 5fcb106399ea3db0f4bb7fe2ad2412519852c5694f2e89ec567c6d2315c07ab9
Sep 15 21:12:35.113342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.113300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:35.327681 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.327573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:35.710023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.709987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:35.826734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.826697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" event={"ID":"f8f5153c-d823-49d9-901e-02c8cf81859a","Type":"ContainerStarted","Data":"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"}
Sep 15 21:12:35.827219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.826756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" event={"ID":"f8f5153c-d823-49d9-901e-02c8cf81859a","Type":"ContainerStarted","Data":"5fcb106399ea3db0f4bb7fe2ad2412519852c5694f2e89ec567c6d2315c07ab9"}
Sep 15 21:12:35.827219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.826781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:12:35.828407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.828380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9c7c9d6-qrjlt" event={"ID":"00a6e246-d23d-403c-91bf-9f7b649e7930","Type":"ContainerStarted","Data":"dbc4832b06c6d23d7485b7fc617f13b0ad6c3c2cec88fc03c3efb81abb762679"}
Sep 15 21:12:35.828530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.828428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9c7c9d6-qrjlt" event={"ID":"00a6e246-d23d-403c-91bf-9f7b649e7930","Type":"ContainerStarted","Data":"448a6c4fbe522907d5e418d850945847117bb4154d00f2fb06cc945bcf508bfb"}
Sep 15 21:12:35.847650 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.847584    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" podStartSLOduration=17.847566479 podStartE2EDuration="17.847566479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:35.846678717 +0000 UTC m=+250.251000765" watchObservedRunningTime="2026-09-15 21:12:35.847566479 +0000 UTC m=+250.251888526"
Sep 15 21:12:35.865763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:35.865708    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9c7c9d6-qrjlt" podStartSLOduration=17.865689468 podStartE2EDuration="17.865689468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:35.864852399 +0000 UTC m=+250.269174445" watchObservedRunningTime="2026-09-15 21:12:35.865689468 +0000 UTC m=+250.270011514"
Sep 15 21:12:36.199308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.199270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:36.313559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.313522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:36.633197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.633165    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:36.637205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.637174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:36.835386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.834254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:36.836919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.836895    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9c7c9d6-qrjlt"
Sep 15 21:12:36.932928 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:36.932838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:37.120133 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:37.120098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:37.511444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:37.511412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:37.710795 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:37.710763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:37.878327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:37.878293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:12:37.880674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:37.880643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be174629-7667-4599-b792-257633f812fa-metrics-certs\") pod \"network-metrics-daemon-mv7mh\" (UID: \"be174629-7667-4599-b792-257633f812fa\") " pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:12:38.180346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.180259    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lj4g\""
Sep 15 21:12:38.188522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.188495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mv7mh"
Sep 15 21:12:38.311357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.311322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.468191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.468107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mv7mh"]
Sep 15 21:12:38.471154 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:38.471127    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe174629_7667_4599_b792_257633f812fa.slice/crio-ac0189a4347fbeb43cf5f5dd1fa8bcdb9984fc0e09396c13d16c49ddcbe78c79 WatchSource:0}: Error finding container ac0189a4347fbeb43cf5f5dd1fa8bcdb9984fc0e09396c13d16c49ddcbe78c79: Status 404 returned error can't find the container with id ac0189a4347fbeb43cf5f5dd1fa8bcdb9984fc0e09396c13d16c49ddcbe78c79
Sep 15 21:12:38.520621 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.520575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.720562 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.720467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.771931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.771890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.841168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:38.841136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv7mh" event={"ID":"be174629-7667-4599-b792-257633f812fa","Type":"ContainerStarted","Data":"ac0189a4347fbeb43cf5f5dd1fa8bcdb9984fc0e09396c13d16c49ddcbe78c79"}
Sep 15 21:12:39.390453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.390414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:39.390850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.390475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:39.391080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.391058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ade8a6ca-4529-4353-a7e9-5648e2199793-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:39.392889 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.392860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ade8a6ca-4529-4353-a7e9-5648e2199793-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hn7xp\" (UID: \"ade8a6ca-4529-4353-a7e9-5648e2199793\") " pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:39.451993 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.451955    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8r4hc\""
Sep 15 21:12:39.459525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.459485    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hn7xp"
Sep 15 21:12:39.736468 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.736286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hn7xp"]
Sep 15 21:12:39.739218 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:12:39.739195    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade8a6ca_4529_4353_a7e9_5648e2199793.slice/crio-c1f235e9e1d974c7c9f1dce2941936171578f98bb5d87fb819e373a767ad17fc WatchSource:0}: Error finding container c1f235e9e1d974c7c9f1dce2941936171578f98bb5d87fb819e373a767ad17fc: Status 404 returned error can't find the container with id c1f235e9e1d974c7c9f1dce2941936171578f98bb5d87fb819e373a767ad17fc
Sep 15 21:12:39.846631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.846585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv7mh" event={"ID":"be174629-7667-4599-b792-257633f812fa","Type":"ContainerStarted","Data":"2e989d57ec86d3e695353876c1355d9c7826755d2bea9903eb7520ecb4e0178b"}
Sep 15 21:12:39.846833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.846654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mv7mh" event={"ID":"be174629-7667-4599-b792-257633f812fa","Type":"ContainerStarted","Data":"8683c7321b88b18085047150288637d780c096c3159836d7df5d82ce673585fd"}
Sep 15 21:12:39.848071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.848047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hn7xp" event={"ID":"ade8a6ca-4529-4353-a7e9-5648e2199793","Type":"ContainerStarted","Data":"ab57ffb53513735eac6b2295aef7c783acd7d266a9462983c52c4c8ff77453b3"}
Sep 15 21:12:39.848190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.848091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hn7xp" event={"ID":"ade8a6ca-4529-4353-a7e9-5648e2199793","Type":"ContainerStarted","Data":"c1f235e9e1d974c7c9f1dce2941936171578f98bb5d87fb819e373a767ad17fc"}
Sep 15 21:12:39.864409 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:39.864352    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mv7mh" podStartSLOduration=252.921041811 podStartE2EDuration="4m13.864329933s" totalImagesPullingTime="943.288122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:39.862752816 +0000 UTC m=+254.267074862" watchObservedRunningTime="2026-09-15 21:12:39.864329933 +0000 UTC m=+254.268652011"
Sep 15 21:12:40.853418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:40.853378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hn7xp" event={"ID":"ade8a6ca-4529-4353-a7e9-5648e2199793","Type":"ContainerStarted","Data":"a87355c8310d8a8b6bf4efbe6e4c41aae9e6019201c6285d2b038aee2c075ee2"}
Sep 15 21:12:42.863004 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:42.862965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hn7xp" event={"ID":"ade8a6ca-4529-4353-a7e9-5648e2199793","Type":"ContainerStarted","Data":"79fb9de19b6a0794c701ce19bee6d97860dae07f25cece6a74427b627fd79b3a"}
Sep 15 21:12:42.880267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:42.879698    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hn7xp" podStartSLOduration=17.646596539 podStartE2EDuration="19.879675207s" totalImagesPullingTime="2.233078668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:12:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:42.879180409 +0000 UTC m=+257.283502457" watchObservedRunningTime="2026-09-15 21:12:42.879675207 +0000 UTC m=+257.283997267"
Sep 15 21:12:43.898254 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:43.898201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:43.954503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:43.954460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:44.075989 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.075929    2560 scope.go:117] "RemoveContainer" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"
Sep 15 21:12:44.870317 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.870284    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:12:44.870720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.870702    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/1.log"
Sep 15 21:12:44.870763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.870740    2560 generic.go:356] "Generic (PLEG): container finished" podID="379493e1-5577-4f36-bb77-89dbc4f8d352" containerID="0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300" exitCode=255
Sep 15 21:12:44.870793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.870777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" event={"ID":"379493e1-5577-4f36-bb77-89dbc4f8d352","Type":"ContainerDied","Data":"0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300"}
Sep 15 21:12:44.870841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.870830    2560 scope.go:117] "RemoveContainer" containerID="5bf2a3e739d5f59c1490c2d05a3ca7e284312d97d899b0c089410f4e47af684a"
Sep 15 21:12:44.871185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:44.871170    2560 scope.go:117] "RemoveContainer" containerID="0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300"
Sep 15 21:12:44.871356 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:44.871338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:12:45.604892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:45.604848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:12:45.686266 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:45.686229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:45.780198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:45.780163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:45.875226 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:45.875143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:12:49.207385 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:49.207297    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:49.207385 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:49.207353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:12:49.207848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:49.207661    2560 scope.go:117] "RemoveContainer" containerID="0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300"
Sep 15 21:12:49.207848 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:12:49.207805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:12:53.346729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:53.346685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.448043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:53.448009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.530227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:53.530193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.899968 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:53.899900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.962840 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:53.962769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:54.066492 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:54.066458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:55.610561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:55.610523    2560 patch_prober.go:28] interesting pod/image-registry-844b5df7cd-b7x2z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 21:12:55.610926 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:55.610616    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 21:12:57.540016 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:57.539968    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:57.624384 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:57.624347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:57.728637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:57.728602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:59.646134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:12:59.646100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:01.668898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:01.668864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:01.901369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:01.901335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.002679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.002598    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"]
Sep 15 21:13:02.005022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.005002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.009551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.009523    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 21:13:02.009551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.009524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 21:13:02.009784 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.009564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 21:13:02.009784 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.009585    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 21:13:02.009883 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.009867    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 21:13:02.010458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.010438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jflmj\""
Sep 15 21:13:02.010985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.010968    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 21:13:02.015437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.015411    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pmr4q"]
Sep 15 21:13:02.022205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.022173    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.024839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.024806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.027381 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.027357    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 21:13:02.027515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.027411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 21:13:02.027897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.027880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lwmf4\""
Sep 15 21:13:02.028060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.028045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 21:13:02.038660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.038622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"]
Sep 15 21:13:02.049614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.049782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.049782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-sys\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.049782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.049782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.049931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-metrics-client-ca\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.049931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq857\" (UniqueName: \"kubernetes.io/projected/5b197dda-05f7-456c-9675-0f873078b9b9-kube-api-access-wq857\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.049931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-textfile\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.049931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.050078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.049983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b197dda-05f7-456c-9675-0f873078b9b9-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.050078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.050011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.050078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.050036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v448w\" (UniqueName: \"kubernetes.io/projected/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-kube-api-access-v448w\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.050078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.050062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-root\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.050210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.050093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-tls\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.050210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.050126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-wtmp\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-metrics-client-ca\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq857\" (UniqueName: \"kubernetes.io/projected/5b197dda-05f7-456c-9675-0f873078b9b9-kube-api-access-wq857\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-textfile\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b197dda-05f7-456c-9675-0f873078b9b9-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v448w\" (UniqueName: \"kubernetes.io/projected/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-kube-api-access-v448w\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-root\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-tls\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.150754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-wtmp\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-sys\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-root\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.150954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-textfile\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:13:02.151043    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:13:02.151107    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls podName:5b197dda-05f7-456c-9675-0f873078b9b9 nodeName:}" failed. No retries permitted until 2026-09-15 21:13:02.651088282 +0000 UTC m=+277.055410312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-l8nw6" (UID: "5b197dda-05f7-456c-9675-0f873078b9b9") : secret "kube-state-metrics-tls" not found
Sep 15 21:13:02.151195 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-metrics-client-ca\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b197dda-05f7-456c-9675-0f873078b9b9-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.151720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-wtmp\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-sys\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.151720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.152005 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.151861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b197dda-05f7-456c-9675-0f873078b9b9-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.153779 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.153753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.153956 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.153845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.153956 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.153888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-node-exporter-tls\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.168732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.168682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq857\" (UniqueName: \"kubernetes.io/projected/5b197dda-05f7-456c-9675-0f873078b9b9-kube-api-access-wq857\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.171494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.171453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v448w\" (UniqueName: \"kubernetes.io/projected/f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1-kube-api-access-v448w\") pod \"node-exporter-pmr4q\" (UID: \"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1\") " pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.331694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.331600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmr4q"
Sep 15 21:13:02.342842 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:13:02.342806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a22714_f5c9_4f1a_b35b_386e2d0fc8a1.slice/crio-0c599137ccf36941aa3e452f62ffc432f31e35016a8ba8695be9b9c8c89fdff2 WatchSource:0}: Error finding container 0c599137ccf36941aa3e452f62ffc432f31e35016a8ba8695be9b9c8c89fdff2: Status 404 returned error can't find the container with id 0c599137ccf36941aa3e452f62ffc432f31e35016a8ba8695be9b9c8c89fdff2
Sep 15 21:13:02.391329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.391272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.493839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.493802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.579102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.579036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.653495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.653453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.655875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.655848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b197dda-05f7-456c-9675-0f873078b9b9-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-l8nw6\" (UID: \"5b197dda-05f7-456c-9675-0f873078b9b9\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.684262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.684231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.915680 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.915587    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"
Sep 15 21:13:02.932751 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.932703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmr4q" event={"ID":"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1","Type":"ContainerStarted","Data":"0c599137ccf36941aa3e452f62ffc432f31e35016a8ba8695be9b9c8c89fdff2"}
Sep 15 21:13:02.947802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:02.947730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:03.061170 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.061130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:03.076495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.076462    2560 scope.go:117] "RemoveContainer" containerID="0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300"
Sep 15 21:13:03.076697 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:13:03.076664    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-sl8vh_openshift-console-operator(379493e1-5577-4f36-bb77-89dbc4f8d352)\"" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podUID="379493e1-5577-4f36-bb77-89dbc4f8d352"
Sep 15 21:13:03.151360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.151325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:03.203109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.203012    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6"]
Sep 15 21:13:03.285857 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:13:03.285823    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b197dda_05f7_456c_9675_0f873078b9b9.slice/crio-da03fc6abdf0533bfb5b9d01faa1d7a46050861cd03d739bc637917f260f6445 WatchSource:0}: Error finding container da03fc6abdf0533bfb5b9d01faa1d7a46050861cd03d739bc637917f260f6445: Status 404 returned error can't find the container with id da03fc6abdf0533bfb5b9d01faa1d7a46050861cd03d739bc637917f260f6445
Sep 15 21:13:03.938758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.938717    2560 generic.go:356] "Generic (PLEG): container finished" podID="f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1" containerID="9c76018baf64abbb14f6d541b2ff3bacf4219705c03776eb7df1d7b57991b966" exitCode=0
Sep 15 21:13:03.939323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.938806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmr4q" event={"ID":"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1","Type":"ContainerDied","Data":"9c76018baf64abbb14f6d541b2ff3bacf4219705c03776eb7df1d7b57991b966"}
Sep 15 21:13:03.940565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:03.940529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6" event={"ID":"5b197dda-05f7-456c-9675-0f873078b9b9","Type":"ContainerStarted","Data":"da03fc6abdf0533bfb5b9d01faa1d7a46050861cd03d739bc637917f260f6445"}
Sep 15 21:13:04.905836 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.905799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:04.948287 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.948247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6" event={"ID":"5b197dda-05f7-456c-9675-0f873078b9b9","Type":"ContainerStarted","Data":"a96263b05567d1a5fd2baf8e36812dd49d4f6d5f7b0240173b64442b639fe6ae"}
Sep 15 21:13:04.948815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.948320    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6" event={"ID":"5b197dda-05f7-456c-9675-0f873078b9b9","Type":"ContainerStarted","Data":"1f4526208009db47f49678dcde33252d23da42620c7a3250aba0fad52e328342"}
Sep 15 21:13:04.948815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.948350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6" event={"ID":"5b197dda-05f7-456c-9675-0f873078b9b9","Type":"ContainerStarted","Data":"8040f453a161fb15b11822aa8653d0237c68c00dea153f96353c6760ef68bb70"}
Sep 15 21:13:04.950886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.950853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmr4q" event={"ID":"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1","Type":"ContainerStarted","Data":"d598fbbc268afaaf95c6c253e0791a35a3ab69e9b2b05a4320e80e8d920e98c9"}
Sep 15 21:13:04.951044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.950912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmr4q" event={"ID":"f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1","Type":"ContainerStarted","Data":"af4c07d6449d8a9147289606e57f249ab7d35d1dd588987ce0d97c401b4200b4"}
Sep 15 21:13:04.973325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:04.973272    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-l8nw6" podStartSLOduration=2.82653093 podStartE2EDuration="3.973255197s" totalImagesPullingTime="1.146724267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:04.971187029 +0000 UTC m=+279.375509077" watchObservedRunningTime="2026-09-15 21:13:04.973255197 +0000 UTC m=+279.377577282"
Sep 15 21:13:05.005801 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:05.005770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:05.015088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:05.015030    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pmr4q" podStartSLOduration=2.984235102 podStartE2EDuration="4.015010305s" totalImagesPullingTime="966.493111ms" totalInitContainerRuntime="64.282092ms" isStatefulPod=true podCreationTimestamp="2026-09-15 21:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:05.008469084 +0000 UTC m=+279.412791132" watchObservedRunningTime="2026-09-15 21:13:05.015010305 +0000 UTC m=+279.419332352"
Sep 15 21:13:05.108348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:05.108314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:05.610266 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:05.610236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:13:06.575181 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:13:06.575118    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zgtzk" podUID="361ced3c-80ec-46da-b412-3f13aa982c46"
Sep 15 21:13:06.684371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.684336    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"]
Sep 15 21:13:06.687247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.687226    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.689555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.689531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 21:13:06.689920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.689907    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dcbfs\""
Sep 15 21:13:06.695761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.695734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"]
Sep 15 21:13:06.786973 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.786915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7n4\" (UniqueName: \"kubernetes.io/projected/af1beee8-f7c6-483f-9caf-ae7131df5bf5-kube-api-access-mk7n4\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.787149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.787037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af1beee8-f7c6-483f-9caf-ae7131df5bf5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.887637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.887598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7n4\" (UniqueName: \"kubernetes.io/projected/af1beee8-f7c6-483f-9caf-ae7131df5bf5-kube-api-access-mk7n4\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.887842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.887668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af1beee8-f7c6-483f-9caf-ae7131df5bf5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.890110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.890089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/af1beee8-f7c6-483f-9caf-ae7131df5bf5-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.896533 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.896505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7n4\" (UniqueName: \"kubernetes.io/projected/af1beee8-f7c6-483f-9caf-ae7131df5bf5-kube-api-access-mk7n4\") pod \"monitoring-plugin-5d85778b9d-rdxtt\" (UID: \"af1beee8-f7c6-483f-9caf-ae7131df5bf5\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:06.957380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.957349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:06.996537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:06.996503    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:07.179608 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.179514    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5458b59669-xgm5f"]
Sep 15 21:13:07.182807 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.182782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.187796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.187763    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 21:13:07.187948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.187834    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 21:13:07.188105 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.188088    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 21:13:07.188187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.188118    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 21:13:07.188187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.188137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 21:13:07.188187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.188091    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kmzfq\""
Sep 15 21:13:07.190392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-federate-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjv7q\" (UniqueName: \"kubernetes.io/projected/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-kube-api-access-pjv7q\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-metrics-client-ca\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.190797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.190635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-serving-certs-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.191681 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.191664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 21:13:07.201633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.201604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5458b59669-xgm5f"]
Sep 15 21:13:07.269325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.269300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"]
Sep 15 21:13:07.271599 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:13:07.271572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1beee8_f7c6_483f_9caf_ae7131df5bf5.slice/crio-fde2a33ec8293f17b66c80a39e06061203cadd9dae38362a50f213187be97e25 WatchSource:0}: Error finding container fde2a33ec8293f17b66c80a39e06061203cadd9dae38362a50f213187be97e25: Status 404 returned error can't find the container with id fde2a33ec8293f17b66c80a39e06061203cadd9dae38362a50f213187be97e25
Sep 15 21:13:07.291086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-metrics-client-ca\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-serving-certs-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-federate-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.291519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.291482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjv7q\" (UniqueName: \"kubernetes.io/projected/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-kube-api-access-pjv7q\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.292058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.292029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-serving-certs-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.292199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.292040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-metrics-client-ca\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.292199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.292092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.293756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.293736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.293947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.293918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.294170 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.294154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-telemeter-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.294238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.294221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-federate-client-tls\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.300069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.300050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjv7q\" (UniqueName: \"kubernetes.io/projected/f640e9a6-d515-41f5-9af4-3a83efdf6fc2-kube-api-access-pjv7q\") pod \"telemeter-client-5458b59669-xgm5f\" (UID: \"f640e9a6-d515-41f5-9af4-3a83efdf6fc2\") " pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.372164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.372129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:07.493054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.492971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f"
Sep 15 21:13:07.783598 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.780598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5458b59669-xgm5f"]
Sep 15 21:13:07.963470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.963428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f" event={"ID":"f640e9a6-d515-41f5-9af4-3a83efdf6fc2","Type":"ContainerStarted","Data":"7f15e40c39b13a5640c8e2a27b85a07d92ab62a53fc4b0f398285e7fa2c567b0"}
Sep 15 21:13:07.964837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:07.964796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt" event={"ID":"af1beee8-f7c6-483f-9caf-ae7131df5bf5","Type":"ContainerStarted","Data":"fde2a33ec8293f17b66c80a39e06061203cadd9dae38362a50f213187be97e25"}
Sep 15 21:13:08.041363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.041270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:08.108468 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.108426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:08.232188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.232080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:08.970072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.969970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt" event={"ID":"af1beee8-f7c6-483f-9caf-ae7131df5bf5","Type":"ContainerStarted","Data":"66d7967481471039ec94b339f40d85f0ee23f2d83d2aeb3f86208b7338ad0245"}
Sep 15 21:13:08.970478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.970169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:08.976468 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.976433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt"
Sep 15 21:13:08.985806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:08.985757    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rdxtt" podStartSLOduration=1.6223332240000001 podStartE2EDuration="2.985741037s" totalImagesPullingTime="1.363407813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:08.984911238 +0000 UTC m=+283.389233286" watchObservedRunningTime="2026-09-15 21:13:08.985741037 +0000 UTC m=+283.390063081"
Sep 15 21:13:09.977793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:09.977747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f" event={"ID":"f640e9a6-d515-41f5-9af4-3a83efdf6fc2","Type":"ContainerStarted","Data":"34a8dfbe34b9d58e8f21c5c3984a979e9d6dc4288c4b0e266ddd52bd4ace2fdd"}
Sep 15 21:13:10.425043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.425002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:10.427374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.427348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/361ced3c-80ec-46da-b412-3f13aa982c46-metrics-tls\") pod \"dns-default-zgtzk\" (UID: \"361ced3c-80ec-46da-b412-3f13aa982c46\") " pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:10.560839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.560812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5jgl\""
Sep 15 21:13:10.568707 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.568657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:10.625122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.625085    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerName="registry" containerID="cri-o://719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055" gracePeriod=30
Sep 15 21:13:10.844458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.844329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgtzk"]
Sep 15 21:13:10.847403 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:13:10.847372    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361ced3c_80ec_46da_b412_3f13aa982c46.slice/crio-ed9cb879a875142ea2a592d359e9e372b6ca78eef22283c7f953771501ba1a09 WatchSource:0}: Error finding container ed9cb879a875142ea2a592d359e9e372b6ca78eef22283c7f953771501ba1a09: Status 404 returned error can't find the container with id ed9cb879a875142ea2a592d359e9e372b6ca78eef22283c7f953771501ba1a09
Sep 15 21:13:10.856961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.856914    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:13:10.929171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929183    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929229    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929281    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chkhx\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929356    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration\") pod \"f8f5153c-d823-49d9-901e-02c8cf81859a\" (UID: \"f8f5153c-d823-49d9-901e-02c8cf81859a\") "
Sep 15 21:13:10.929719 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.929672    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:13:10.930154 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.930123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:13:10.931727 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.931698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:10.931910 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.931889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx" (OuterVolumeSpecName: "kube-api-access-chkhx") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "kube-api-access-chkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:10.931999 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.931916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:13:10.931999 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.931931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:10.932109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.932084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:13:10.937559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.937525    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f8f5153c-d823-49d9-901e-02c8cf81859a" (UID: "f8f5153c-d823-49d9-901e-02c8cf81859a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:13:10.983877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.983841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f" event={"ID":"f640e9a6-d515-41f5-9af4-3a83efdf6fc2","Type":"ContainerStarted","Data":"3db5b6085fb27192a055a3c625b4df8e78ecfeb14ddef338301fea67abf18a8e"}
Sep 15 21:13:10.984350 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.983901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f" event={"ID":"f640e9a6-d515-41f5-9af4-3a83efdf6fc2","Type":"ContainerStarted","Data":"541f5b6cbb4bef44dff9af4d873e19c31856aa3cea9d73f629a76424e4eaf556"}
Sep 15 21:13:10.985139 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.985115    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerID="719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055" exitCode=0
Sep 15 21:13:10.985247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.985152    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z"
Sep 15 21:13:10.985247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.985181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" event={"ID":"f8f5153c-d823-49d9-901e-02c8cf81859a","Type":"ContainerDied","Data":"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"}
Sep 15 21:13:10.985247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.985216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b5df7cd-b7x2z" event={"ID":"f8f5153c-d823-49d9-901e-02c8cf81859a","Type":"ContainerDied","Data":"5fcb106399ea3db0f4bb7fe2ad2412519852c5694f2e89ec567c6d2315c07ab9"}
Sep 15 21:13:10.985247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.985242    2560 scope.go:117] "RemoveContainer" containerID="719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"
Sep 15 21:13:10.986525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.986474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgtzk" event={"ID":"361ced3c-80ec-46da-b412-3f13aa982c46","Type":"ContainerStarted","Data":"ed9cb879a875142ea2a592d359e9e372b6ca78eef22283c7f953771501ba1a09"}
Sep 15 21:13:10.993970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.993927    2560 scope.go:117] "RemoveContainer" containerID="719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"
Sep 15 21:13:10.994305 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:13:10.994287    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055\": container with ID starting with 719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055 not found: ID does not exist" containerID="719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"
Sep 15 21:13:10.994370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:10.994314    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055"} err="failed to get container status \"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055\": rpc error: code = NotFound desc = could not find container \"719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055\": container with ID starting with 719ee77a199cd3a3597dc1c11796cdf8cabf48d845a0778d6028bb6be7d71055 not found: ID does not exist"
Sep 15 21:13:11.005386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.005330    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5458b59669-xgm5f" podStartSLOduration=1.408646805 podStartE2EDuration="4.005314267s" totalImagesPullingTime="2.596667462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:13:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:11.003807739 +0000 UTC m=+285.408129786" watchObservedRunningTime="2026-09-15 21:13:11.005314267 +0000 UTC m=+285.409636314"
Sep 15 21:13:11.019535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.019497    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:13:11.027212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.027181    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-844b5df7cd-b7x2z"]
Sep 15 21:13:11.030924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030885    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8f5153c-d823-49d9-901e-02c8cf81859a-ca-trust-extracted\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.030924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030916    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-bound-sa-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.030924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030929    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chkhx\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-kube-api-access-chkhx\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.031192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030965    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-image-registry-private-configuration\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.031192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030975    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-trusted-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.031192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030983    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8f5153c-d823-49d9-901e-02c8cf81859a-installation-pull-secrets\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.031192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.030993    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:11.031192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:11.031001    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8f5153c-d823-49d9-901e-02c8cf81859a-registry-certificates\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:13:12.080864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:12.080829    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" path="/var/lib/kubelet/pods/f8f5153c-d823-49d9-901e-02c8cf81859a/volumes"
Sep 15 21:13:13.001177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:13.001132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgtzk" event={"ID":"361ced3c-80ec-46da-b412-3f13aa982c46","Type":"ContainerStarted","Data":"4a61e85891d92889148d40b4fa4a3071b178f9661f2096cc72c60ccbbd26d6e3"}
Sep 15 21:13:13.001322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:13.001195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgtzk" event={"ID":"361ced3c-80ec-46da-b412-3f13aa982c46","Type":"ContainerStarted","Data":"2f7d7262da6c917d3ffa2ba33e904b699f7c976aa5529c70f99697b16e35605a"}
Sep 15 21:13:13.001322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:13.001224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:13.018580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:13.018523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zgtzk" podStartSLOduration=251.408901937 podStartE2EDuration="4m13.01850661s" totalImagesPullingTime="1.609604673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:13.017180868 +0000 UTC m=+287.421502916" watchObservedRunningTime="2026-09-15 21:13:13.01850661 +0000 UTC m=+287.422828690"
Sep 15 21:13:15.076267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.076228    2560 scope.go:117] "RemoveContainer" containerID="0adb8eed036378f8889148a9b34cf6981e7b9f8aab33d3bef1b332dc824a1300"
Sep 15 21:13:15.918816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.918777    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-qkrt6"]
Sep 15 21:13:15.919094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.919081    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerName="registry"
Sep 15 21:13:15.919136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.919097    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerName="registry"
Sep 15 21:13:15.919184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.919153    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f5153c-d823-49d9-901e-02c8cf81859a" containerName="registry"
Sep 15 21:13:15.922274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.922246    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:15.924905 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.924877    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 21:13:15.925097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.925066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 21:13:15.925235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.925158    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hct6l\""
Sep 15 21:13:15.932955 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.932905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qkrt6"]
Sep 15 21:13:15.940620 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.940594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:15.969537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.969494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744h7\" (UniqueName: \"kubernetes.io/projected/90b78359-d892-476a-81b8-9da6b8b8afae-kube-api-access-744h7\") pod \"downloads-76f99584f4-qkrt6\" (UID: \"90b78359-d892-476a-81b8-9da6b8b8afae\") " pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:15.999156 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:15.999125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.015188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.015158    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:13:16.015360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.015237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" event={"ID":"379493e1-5577-4f36-bb77-89dbc4f8d352","Type":"ContainerStarted","Data":"f7980419b2253cb28b90215fde9f31376c39be114922acf20b26e63419d28b3e"}
Sep 15 21:13:16.015493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.015466    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:13:16.020452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.020423    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh"
Sep 15 21:13:16.035080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.035021    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-sl8vh" podStartSLOduration=55.090606284 podStartE2EDuration="58.03500316s" totalImagesPullingTime="2.944396876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:16.033667813 +0000 UTC m=+290.437989860" watchObservedRunningTime="2026-09-15 21:13:16.03500316 +0000 UTC m=+290.439325206"
Sep 15 21:13:16.070370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.070333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744h7\" (UniqueName: \"kubernetes.io/projected/90b78359-d892-476a-81b8-9da6b8b8afae-kube-api-access-744h7\") pod \"downloads-76f99584f4-qkrt6\" (UID: \"90b78359-d892-476a-81b8-9da6b8b8afae\") " pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:16.079379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.079347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744h7\" (UniqueName: \"kubernetes.io/projected/90b78359-d892-476a-81b8-9da6b8b8afae-kube-api-access-744h7\") pod \"downloads-76f99584f4-qkrt6\" (UID: \"90b78359-d892-476a-81b8-9da6b8b8afae\") " pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:16.101238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.101190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.232435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.232326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:16.246871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.246824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.436918 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.436885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.489506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.489435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.507828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.506679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qkrt6"]
Sep 15 21:13:16.803496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.803409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.904701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:16.904666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:17.018421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.018379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:17.020738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.020697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qkrt6" event={"ID":"90b78359-d892-476a-81b8-9da6b8b8afae","Type":"ContainerStarted","Data":"40569edf526e935f609ef2d2203e22b269fa6581caf4efae151c2dd914b6e0f6"}
Sep 15 21:13:17.209744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.209702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:17.309871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.309833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:17.616323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.616286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:17.811280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:17.811234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:18.208860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:18.208829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:19.431858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:19.431821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:19.490215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:19.490177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:20.054593 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:20.054551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:20.109641 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:20.109607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:23.008124 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:23.008086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zgtzk"
Sep 15 21:13:25.998558 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:25.998526    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:13:25.999756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:25.999733    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:13:26.016270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.016238    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 21:13:26.437616 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.437576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:26.522146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.522104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:26.525783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.525750    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:13:26.529392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.529365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.532167 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.532142    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 21:13:26.532441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.532420    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 21:13:26.533327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.533304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 21:13:26.533426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.533314    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2wzw\""
Sep 15 21:13:26.533426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.533346    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 21:13:26.533426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.533362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 21:13:26.545561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.542146    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:13:26.662179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.662179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.662423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.662423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pn7s\" (UniqueName: \"kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.662423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.662548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.662427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.762905 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.762811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.762905 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.762864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.762922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.762960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.762982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.763008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pn7s\" (UniqueName: \"kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.763755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.763740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.763987 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.763754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.765701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.765676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.765815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.765783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.771744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.771715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pn7s\" (UniqueName: \"kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s\") pod \"console-56dfb56b-929dt\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") " pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:26.842150 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:26.842109    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:28.635397 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:28.635360    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:28.691960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:28.691902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:28.896988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:28.896889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:28.997272 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:28.997237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:29.138533 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:29.138489    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:29.240328 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:29.240246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:29.905075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:29.905030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:29.965618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:29.965583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:32.848394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:32.848356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:32.949864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:32.949812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:33.637177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:33.637090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:13:33.640847 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:13:33.640812    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8878267_81e3_4aff_a82b_d1a0905028fd.slice/crio-3bb3dc203638c8b257b54acf869c66176c91c523802c160fb42e03ecea6280ae WatchSource:0}: Error finding container 3bb3dc203638c8b257b54acf869c66176c91c523802c160fb42e03ecea6280ae: Status 404 returned error can't find the container with id 3bb3dc203638c8b257b54acf869c66176c91c523802c160fb42e03ecea6280ae
Sep 15 21:13:33.643430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:33.643407    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:13:34.091269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:34.091181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfb56b-929dt" event={"ID":"d8878267-81e3-4aff-a82b-d1a0905028fd","Type":"ContainerStarted","Data":"3bb3dc203638c8b257b54acf869c66176c91c523802c160fb42e03ecea6280ae"}
Sep 15 21:13:34.093026 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:34.092994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qkrt6" event={"ID":"90b78359-d892-476a-81b8-9da6b8b8afae","Type":"ContainerStarted","Data":"33f0b578422bf8c416d088c68bbefd62571f404f76961092cc8bf1753d5fc788"}
Sep 15 21:13:34.093242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:34.093218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:34.103344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:34.103313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-qkrt6"
Sep 15 21:13:34.111519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:34.111455    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-qkrt6" podStartSLOduration=2.157594325 podStartE2EDuration="19.111439951s" totalImagesPullingTime="16.953845626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:34.110147076 +0000 UTC m=+308.514469128" watchObservedRunningTime="2026-09-15 21:13:34.111439951 +0000 UTC m=+308.515761998"
Sep 15 21:13:37.650781 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:37.650742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:37.752202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:37.752121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:38.114730 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:38.114694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfb56b-929dt" event={"ID":"d8878267-81e3-4aff-a82b-d1a0905028fd","Type":"ContainerStarted","Data":"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"}
Sep 15 21:13:38.137507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:38.137445    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dfb56b-929dt" podStartSLOduration=8.299566689 podStartE2EDuration="12.137427887s" totalImagesPullingTime="3.837861198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:13:38.13626313 +0000 UTC m=+312.540585179" watchObservedRunningTime="2026-09-15 21:13:38.137427887 +0000 UTC m=+312.541749999"
Sep 15 21:13:38.910379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:38.910332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:43.884305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:43.884269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:43.941603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:43.941560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:44.040559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:44.040529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:44.104670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:44.104628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:46.843179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:46.843136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:46.843676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:46.843199    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:46.848142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:46.848116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:46.935807 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:46.935773    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:13:47.155070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:47.155040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:13:48.156702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:48.156666    2560 generic.go:356] "Generic (PLEG): container finished" podID="deb8d311-ea1d-4355-97b5-4d50b7bb9d36" containerID="ee80f0f809076e1a9c231ad31f833a890042822c2714039b565d8f89729f58ed" exitCode=0
Sep 15 21:13:48.157185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:48.156752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lhfh5" event={"ID":"deb8d311-ea1d-4355-97b5-4d50b7bb9d36","Type":"ContainerDied","Data":"ee80f0f809076e1a9c231ad31f833a890042822c2714039b565d8f89729f58ed"}
Sep 15 21:13:48.157336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:48.157308    2560 scope.go:117] "RemoveContainer" containerID="ee80f0f809076e1a9c231ad31f833a890042822c2714039b565d8f89729f58ed"
Sep 15 21:13:48.842992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:48.842917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:48.897535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:48.897487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:49.036785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.036759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c7c9d6-qrjlt_00a6e246-d23d-403c-91bf-9f7b649e7930/router/0.log"
Sep 15 21:13:49.060322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.060295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9622_08455511-d79f-4864-a164-e7609da524bd/serve-healthcheck-canary/0.log"
Sep 15 21:13:49.171020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.170982    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lhfh5" event={"ID":"deb8d311-ea1d-4355-97b5-4d50b7bb9d36","Type":"ContainerStarted","Data":"4c4b50771963992123c8c307bf9c5ec91a77b946bf29a2291d0e6e0eb7baf6ba"}
Sep 15 21:13:49.517113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.516994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:49.617834 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.617782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:49.718600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.718561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:49.840134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.840029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:49.893877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:49.893832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:52.638293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:52.638234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:52.695337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:52.695301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:54.191873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:54.191838    2560 generic.go:356] "Generic (PLEG): container finished" podID="05c1e1dd-cf30-4c90-85e6-6a07b01e1d70" containerID="d409c736bfcf4ad5a22b11e1a52effb9b459d7caf44c8919db6a4e6185643856" exitCode=0
Sep 15 21:13:54.192310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:54.191911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4" event={"ID":"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70","Type":"ContainerDied","Data":"d409c736bfcf4ad5a22b11e1a52effb9b459d7caf44c8919db6a4e6185643856"}
Sep 15 21:13:54.192310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:54.192269    2560 scope.go:117] "RemoveContainer" containerID="d409c736bfcf4ad5a22b11e1a52effb9b459d7caf44c8919db6a4e6185643856"
Sep 15 21:13:55.197675 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:55.197637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pwhl4" event={"ID":"05c1e1dd-cf30-4c90-85e6-6a07b01e1d70","Type":"ContainerStarted","Data":"2fd08cf307a4570cea3272cbf37cad40c08737772148793725c0e04e14c9f3fe"}
Sep 15 21:13:58.895842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:58.895805    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:58.952669 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:13:58.952631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:13.179297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.179232    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56dfb56b-929dt" podUID="d8878267-81e3-4aff-a82b-d1a0905028fd" containerName="console" containerID="cri-o://6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a" gracePeriod=15
Sep 15 21:14:13.447509 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.447422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:14:13.567067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567109    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567132    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567159    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pn7s\" (UniqueName: \"kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config\") pod \"d8878267-81e3-4aff-a82b-d1a0905028fd\" (UID: \"d8878267-81e3-4aff-a82b-d1a0905028fd\") "
Sep 15 21:14:13.567564 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567536    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config" (OuterVolumeSpecName: "console-config") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:14:13.567609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:14:13.567672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.567597    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:14:13.569571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.569538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:14:13.569571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.569561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:14:13.569711 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.569581    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s" (OuterVolumeSpecName: "kube-api-access-5pn7s") pod "d8878267-81e3-4aff-a82b-d1a0905028fd" (UID: "d8878267-81e3-4aff-a82b-d1a0905028fd"). InnerVolumeSpecName "kube-api-access-5pn7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:14:13.668293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668248    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-oauth-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:13.668293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668284    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-oauth-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:13.668293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668295    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:13.668293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668304    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8878267-81e3-4aff-a82b-d1a0905028fd-console-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:13.668596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668312    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8878267-81e3-4aff-a82b-d1a0905028fd-console-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:13.668596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:13.668321    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pn7s\" (UniqueName: \"kubernetes.io/projected/d8878267-81e3-4aff-a82b-d1a0905028fd-kube-api-access-5pn7s\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:14:14.275708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.275671    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8878267-81e3-4aff-a82b-d1a0905028fd" containerID="6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a" exitCode=0
Sep 15 21:14:14.276111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.275732    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfb56b-929dt"
Sep 15 21:14:14.276111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.275748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfb56b-929dt" event={"ID":"d8878267-81e3-4aff-a82b-d1a0905028fd","Type":"ContainerDied","Data":"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"}
Sep 15 21:14:14.276111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.275799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfb56b-929dt" event={"ID":"d8878267-81e3-4aff-a82b-d1a0905028fd","Type":"ContainerDied","Data":"3bb3dc203638c8b257b54acf869c66176c91c523802c160fb42e03ecea6280ae"}
Sep 15 21:14:14.276111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.275819    2560 scope.go:117] "RemoveContainer" containerID="6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"
Sep 15 21:14:14.285785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.285759    2560 scope.go:117] "RemoveContainer" containerID="6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"
Sep 15 21:14:14.286135 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:14:14.286109    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a\": container with ID starting with 6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a not found: ID does not exist" containerID="6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"
Sep 15 21:14:14.286199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.286138    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a"} err="failed to get container status \"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a\": rpc error: code = NotFound desc = could not find container \"6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a\": container with ID starting with 6d966e04188a46eabf26d99257bb71e6e1eb63c2120bdc8dec2338d918aadb9a not found: ID does not exist"
Sep 15 21:14:14.293484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.293458    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:14:14.300034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:14.300010    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56dfb56b-929dt"]
Sep 15 21:14:16.081439 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:16.081403    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8878267-81e3-4aff-a82b-d1a0905028fd" path="/var/lib/kubelet/pods/d8878267-81e3-4aff-a82b-d1a0905028fd/volumes"
Sep 15 21:14:18.063157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:18.063072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:18.193594 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:18.193567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:18.319386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:18.319301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:18.386328 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:18.386282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:24.305493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.305444    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 21:14:24.306134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.305833    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8878267-81e3-4aff-a82b-d1a0905028fd" containerName="console"
Sep 15 21:14:24.306134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.305847    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8878267-81e3-4aff-a82b-d1a0905028fd" containerName="console"
Sep 15 21:14:24.306134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.305929    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8878267-81e3-4aff-a82b-d1a0905028fd" containerName="console"
Sep 15 21:14:24.309013 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.308985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.312881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.312850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 21:14:24.313116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.312927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 21:14:24.313116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.312850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 21:14:24.313116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.312980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 21:14:24.313116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.313095    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 21:14:24.313326 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.313097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 21:14:24.313599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.313583    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 21:14:24.313691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.313585    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x47qw\""
Sep 15 21:14:24.313996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.313980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 21:14:24.335863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.335828    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 21:14:24.365586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.365555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 21:14:24.458305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-out\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-web-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.458740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.458706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvd4l\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-kube-api-access-cvd4l\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.559740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.559740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.559740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.559816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-web-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvd4l\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-kube-api-access-cvd4l\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-out\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.560859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.560726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.561143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.561119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.561305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.561280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.562965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.563958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.563915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-config-out\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.565003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.564984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-web-config\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.570407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.570381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvd4l\" (UniqueName: \"kubernetes.io/projected/fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6-kube-api-access-cvd4l\") pod \"alertmanager-main-0\" (UID: \"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.619471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.619412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 21:14:24.906191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:24.906156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 21:14:24.909544 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:14:24.909504    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5e85b3_9bb9_4934_843a_1e0bfa88ddd6.slice/crio-cb1626901499f182817dd27b5e4a4b18dc61d88c201464131ee6e1cfeac0a18e WatchSource:0}: Error finding container cb1626901499f182817dd27b5e4a4b18dc61d88c201464131ee6e1cfeac0a18e: Status 404 returned error can't find the container with id cb1626901499f182817dd27b5e4a4b18dc61d88c201464131ee6e1cfeac0a18e
Sep 15 21:14:25.322555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:25.322462    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6" containerID="9f60e8daf54bcb7e69d450ef59aa3cc8367792ffbdb0c24d0901e9148a367595" exitCode=0
Sep 15 21:14:25.322994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:25.322548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerDied","Data":"9f60e8daf54bcb7e69d450ef59aa3cc8367792ffbdb0c24d0901e9148a367595"}
Sep 15 21:14:25.322994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:25.322619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"cb1626901499f182817dd27b5e4a4b18dc61d88c201464131ee6e1cfeac0a18e"}
Sep 15 21:14:27.334970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:27.334849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"ef3169ca202aa566875f56c51785800c45525c8566f8d7cb5aa1f33dda1cfc6c"}
Sep 15 21:14:27.335477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:27.335007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"ea0e18e289326ad7bfd35a0276b3383f92e76f38fdd0bb960fd44df5ec2f5834"}
Sep 15 21:14:27.335477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:27.335054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"1a907fb539b5e5e6cc599c8fbb654ec7b5e7e11a442ae82fc516f5097460f8cb"}
Sep 15 21:14:27.335477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:27.335094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"8133e1cb3b2733ee39164dc9fbb1db0c8be01f1aa136e4017732ecf38dc44b7f"}
Sep 15 21:14:27.335477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:27.335138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"e8ee0a295396fbed1b309f3724976ffcb073aac473cb13d3a7fe4427c9ed7482"}
Sep 15 21:14:28.342494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:28.342338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6","Type":"ContainerStarted","Data":"e9ffa9990340c7ea30e92adf7dda2ed48184d93eb77eb6b9c52052317dc248b6"}
Sep 15 21:14:28.372638 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:28.372586    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.95704222 podStartE2EDuration="4.372566219s" totalImagesPullingTime="2.398633943s" totalInitContainerRuntime="16.890056ms" isStatefulPod=false podCreationTimestamp="2026-09-15 21:14:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:14:28.3711724 +0000 UTC m=+362.775494453" watchObservedRunningTime="2026-09-15 21:14:28.372566219 +0000 UTC m=+362.776888269"
Sep 15 21:14:29.988259 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:29.988209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:30.087754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:30.087688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:37.176654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:37.176620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:37.277656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:37.277620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:39.624060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:39.623305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:39.723881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:39.723846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:39.875018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:39.874885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:40.467551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:40.467516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:40.524111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:40.524040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:42.843589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:42.843544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:43.895823 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:43.895785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:44.001653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:44.001602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:50.250237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:50.250203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:50.305657 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:50.305604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:50.358293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:14:50.358224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:13.509335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:13.509290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:13.612458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:13.612411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:14.383685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.383643    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"]
Sep 15 21:15:14.387121 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.387101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.389505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.389480    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 21:15:14.390531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.390507    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9m6d\""
Sep 15 21:15:14.390602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.390515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 21:15:14.395908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.395866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"]
Sep 15 21:15:14.482862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.482823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.482862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.482874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxx2p\" (UniqueName: \"kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.483112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.482909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.584340 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.584302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.584701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.584395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.584701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.584444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxx2p\" (UniqueName: \"kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.584809 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.584789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.584844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.584788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.593048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.593015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxx2p\" (UniqueName: \"kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.697209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.697114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:14.969278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:14.969229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"]
Sep 15 21:15:14.972105 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:15:14.972071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322ed721_6793_4ac2_a8b1_16c770aca434.slice/crio-1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077 WatchSource:0}: Error finding container 1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077: Status 404 returned error can't find the container with id 1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077
Sep 15 21:15:15.533251 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:15.533211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn" event={"ID":"322ed721-6793-4ac2-a8b1-16c770aca434","Type":"ContainerStarted","Data":"1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077"}
Sep 15 21:15:19.184307 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:19.184268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:22.565560 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:22.565519    2560 generic.go:356] "Generic (PLEG): container finished" podID="322ed721-6793-4ac2-a8b1-16c770aca434" containerID="8d90caf0a56615f90bff2ade364b4147973f43654cfcde27b3b93f7d2c457d52" exitCode=0
Sep 15 21:15:22.565964 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:22.565612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn" event={"ID":"322ed721-6793-4ac2-a8b1-16c770aca434","Type":"ContainerDied","Data":"8d90caf0a56615f90bff2ade364b4147973f43654cfcde27b3b93f7d2c457d52"}
Sep 15 21:15:24.980237 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:15:24.980200    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322ed721_6793_4ac2_a8b1_16c770aca434.slice/crio-b6b7ae4b94f0c4b0a389b7fd6df980b3d2bd28d4a8acf6f48b7af018b105f272.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 21:15:25.584023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:25.583990    2560 generic.go:356] "Generic (PLEG): container finished" podID="322ed721-6793-4ac2-a8b1-16c770aca434" containerID="b6b7ae4b94f0c4b0a389b7fd6df980b3d2bd28d4a8acf6f48b7af018b105f272" exitCode=0
Sep 15 21:15:25.584199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:25.584068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn" event={"ID":"322ed721-6793-4ac2-a8b1-16c770aca434","Type":"ContainerDied","Data":"b6b7ae4b94f0c4b0a389b7fd6df980b3d2bd28d4a8acf6f48b7af018b105f272"}
Sep 15 21:15:30.717785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:30.717744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:34.625602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:34.625567    2560 generic.go:356] "Generic (PLEG): container finished" podID="322ed721-6793-4ac2-a8b1-16c770aca434" containerID="3a2e95c7bd54d56778d7fb3f31969e5bf20845081cf504ea1abd3e9f9d4d17e4" exitCode=0
Sep 15 21:15:34.626028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:34.625646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn" event={"ID":"322ed721-6793-4ac2-a8b1-16c770aca434","Type":"ContainerDied","Data":"3a2e95c7bd54d56778d7fb3f31969e5bf20845081cf504ea1abd3e9f9d4d17e4"}
Sep 15 21:15:35.756738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.756701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:35.870691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.870653    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle\") pod \"322ed721-6793-4ac2-a8b1-16c770aca434\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") "
Sep 15 21:15:35.870880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.870714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util\") pod \"322ed721-6793-4ac2-a8b1-16c770aca434\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") "
Sep 15 21:15:35.870880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.870751    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxx2p\" (UniqueName: \"kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p\") pod \"322ed721-6793-4ac2-a8b1-16c770aca434\" (UID: \"322ed721-6793-4ac2-a8b1-16c770aca434\") "
Sep 15 21:15:35.871333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.871307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle" (OuterVolumeSpecName: "bundle") pod "322ed721-6793-4ac2-a8b1-16c770aca434" (UID: "322ed721-6793-4ac2-a8b1-16c770aca434"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:15:35.873117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.873089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p" (OuterVolumeSpecName: "kube-api-access-lxx2p") pod "322ed721-6793-4ac2-a8b1-16c770aca434" (UID: "322ed721-6793-4ac2-a8b1-16c770aca434"). InnerVolumeSpecName "kube-api-access-lxx2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:15:35.875316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.875293    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util" (OuterVolumeSpecName: "util") pod "322ed721-6793-4ac2-a8b1-16c770aca434" (UID: "322ed721-6793-4ac2-a8b1-16c770aca434"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:15:35.972290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.972192    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:35.972290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.972229    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/322ed721-6793-4ac2-a8b1-16c770aca434-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:35.972290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:35.972244    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxx2p\" (UniqueName: \"kubernetes.io/projected/322ed721-6793-4ac2-a8b1-16c770aca434-kube-api-access-lxx2p\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:36.635869 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:36.635825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn" event={"ID":"322ed721-6793-4ac2-a8b1-16c770aca434","Type":"ContainerDied","Data":"1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077"}
Sep 15 21:15:36.635869 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:36.635856    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pgsqn"
Sep 15 21:15:36.635869 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:36.635876    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1266cb1e44454c371ebe71c86b1a11e73e8671e477b22b9b5ebf3bde6a5c9077"
Sep 15 21:15:40.657720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:40.657683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:42.057487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:42.057447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.284881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:44.284848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.382157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:44.382123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:46.604081 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:46.604040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:46.723791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:46.723754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:46.838302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:46.838267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:47.511545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511506    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"]
Sep 15 21:15:47.511821 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511809    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="util"
Sep 15 21:15:47.511867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511823    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="util"
Sep 15 21:15:47.511867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511833    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="pull"
Sep 15 21:15:47.511867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511838    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="pull"
Sep 15 21:15:47.511867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511845    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="extract"
Sep 15 21:15:47.511867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511850    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="extract"
Sep 15 21:15:47.512043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.511905    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="322ed721-6793-4ac2-a8b1-16c770aca434" containerName="extract"
Sep 15 21:15:47.515383 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.515360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.518142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.518117    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 21:15:47.518283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.518186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9m6d\""
Sep 15 21:15:47.518283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.518217    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 21:15:47.524329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.524300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"]
Sep 15 21:15:47.568808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.568767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbctd\" (UniqueName: \"kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.569028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.568840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.569028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.568876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.669589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.669544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbctd\" (UniqueName: \"kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.670073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.669702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.670073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.669770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.670238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.670214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.670276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.670224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.679267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.679237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbctd\" (UniqueName: \"kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.776666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.776585    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qt6lr"]
Sep 15 21:15:47.779201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.779177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.781921 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.781888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 21:15:47.782062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.781976    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4twbd\""
Sep 15 21:15:47.782230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.782213    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 21:15:47.790306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.790271    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qt6lr"]
Sep 15 21:15:47.825329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.825287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:47.872181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.871990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.872181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.872038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwzd\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-kube-api-access-ktwzd\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.973237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.973192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.973237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.973236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwzd\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-kube-api-access-ktwzd\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.991650 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.991626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:47.992738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:47.992721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwzd\" (UniqueName: \"kubernetes.io/projected/599ba254-fab2-43ce-9da7-9215b46bec47-kube-api-access-ktwzd\") pod \"cert-manager-webhook-6486ffd997-qt6lr\" (UID: \"599ba254-fab2-43ce-9da7-9215b46bec47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:48.088640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.088532    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:48.106191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.106153    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"]
Sep 15 21:15:48.109066 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:15:48.109037    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2581c9_1555_408f_81c8_4bbc2cdfcf50.slice/crio-65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341 WatchSource:0}: Error finding container 65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341: Status 404 returned error can't find the container with id 65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341
Sep 15 21:15:48.370497 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.366802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qt6lr"]
Sep 15 21:15:48.684042 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.683928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr" event={"ID":"599ba254-fab2-43ce-9da7-9215b46bec47","Type":"ContainerStarted","Data":"32f86596583c8f018e8ccb1abc975fa5a1cf7a196a1c90ecd4730d5bcf9ee3a5"}
Sep 15 21:15:48.685537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.685505    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerID="202336c998bb7973fa0ebf462932879176bc286922f14c0cd35d7a022b631dea" exitCode=0
Sep 15 21:15:48.685655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.685586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82" event={"ID":"7e2581c9-1555-408f-81c8-4bbc2cdfcf50","Type":"ContainerDied","Data":"202336c998bb7973fa0ebf462932879176bc286922f14c0cd35d7a022b631dea"}
Sep 15 21:15:48.685707 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:48.685659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82" event={"ID":"7e2581c9-1555-408f-81c8-4bbc2cdfcf50","Type":"ContainerStarted","Data":"65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341"}
Sep 15 21:15:49.047308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.047230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:49.315097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.315002    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"]
Sep 15 21:15:49.317764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.317738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.344915 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.344834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"]
Sep 15 21:15:49.384797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.384742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hplqd\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-kube-api-access-hplqd\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.385066 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.384871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.399139 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.399075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:49.486260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.486076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.486260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.486222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hplqd\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-kube-api-access-hplqd\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.501090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.501025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.501090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.501084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hplqd\" (UniqueName: \"kubernetes.io/projected/c895e208-9637-440f-be77-5c2f4b4afa84-kube-api-access-hplqd\") pod \"cert-manager-cainjector-559cdd8c87-t78xw\" (UID: \"c895e208-9637-440f-be77-5c2f4b4afa84\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.631485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.631427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"
Sep 15 21:15:49.923653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:49.923537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t78xw"]
Sep 15 21:15:49.926491 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:15:49.926456    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc895e208_9637_440f_be77_5c2f4b4afa84.slice/crio-e46a0c8ed83243cdf93bbf48280a47d6cf56985138fd40bf140efbee43069d75 WatchSource:0}: Error finding container e46a0c8ed83243cdf93bbf48280a47d6cf56985138fd40bf140efbee43069d75: Status 404 returned error can't find the container with id e46a0c8ed83243cdf93bbf48280a47d6cf56985138fd40bf140efbee43069d75
Sep 15 21:15:50.697817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:50.697771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw" event={"ID":"c895e208-9637-440f-be77-5c2f4b4afa84","Type":"ContainerStarted","Data":"e46a0c8ed83243cdf93bbf48280a47d6cf56985138fd40bf140efbee43069d75"}
Sep 15 21:15:51.064657 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:51.064561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:51.124122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:51.124066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:52.707455 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.707414    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw" event={"ID":"c895e208-9637-440f-be77-5c2f4b4afa84","Type":"ContainerStarted","Data":"61637872d71928ef58e671876b656e4f439941d99dfbb2b87be104ddefce8398"}
Sep 15 21:15:52.709034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.709002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr" event={"ID":"599ba254-fab2-43ce-9da7-9215b46bec47","Type":"ContainerStarted","Data":"b8f0ca23efe158d0b0acdc7ed4367373118d78224151835943bf616b37af06eb"}
Sep 15 21:15:52.709162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.709066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:15:52.710882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.710852    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerID="841e48bf50a73c89845b735995424298609f405407a2f8944009ee0a43ee97dd" exitCode=0
Sep 15 21:15:52.711019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.710950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82" event={"ID":"7e2581c9-1555-408f-81c8-4bbc2cdfcf50","Type":"ContainerDied","Data":"841e48bf50a73c89845b735995424298609f405407a2f8944009ee0a43ee97dd"}
Sep 15 21:15:52.731642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.731578    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t78xw" podStartSLOduration=2.010784088 podStartE2EDuration="3.731550793s" totalImagesPullingTime="1.720766705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:15:52.729355917 +0000 UTC m=+447.133677969" watchObservedRunningTime="2026-09-15 21:15:52.731550793 +0000 UTC m=+447.135872840"
Sep 15 21:15:52.757957 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:52.757890    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr" podStartSLOduration=2.47050942 podStartE2EDuration="5.757870593s" totalImagesPullingTime="3.287361173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:15:52.756230232 +0000 UTC m=+447.160552281" watchObservedRunningTime="2026-09-15 21:15:52.757870593 +0000 UTC m=+447.162192640"
Sep 15 21:15:53.717635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:53.717596    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerID="49eeee6e5f671e7fea1a62f2725a4c15418c492fe388ae996559e80e851418ff" exitCode=0
Sep 15 21:15:53.718088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:53.717670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82" event={"ID":"7e2581c9-1555-408f-81c8-4bbc2cdfcf50","Type":"ContainerDied","Data":"49eeee6e5f671e7fea1a62f2725a4c15418c492fe388ae996559e80e851418ff"}
Sep 15 21:15:54.851732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.851704    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:54.928214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.928175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util\") pod \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") "
Sep 15 21:15:54.928408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.928250    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbctd\" (UniqueName: \"kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd\") pod \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") "
Sep 15 21:15:54.928408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.928318    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle\") pod \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\" (UID: \"7e2581c9-1555-408f-81c8-4bbc2cdfcf50\") "
Sep 15 21:15:54.928735 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.928699    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle" (OuterVolumeSpecName: "bundle") pod "7e2581c9-1555-408f-81c8-4bbc2cdfcf50" (UID: "7e2581c9-1555-408f-81c8-4bbc2cdfcf50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:15:54.930382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.930358    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd" (OuterVolumeSpecName: "kube-api-access-wbctd") pod "7e2581c9-1555-408f-81c8-4bbc2cdfcf50" (UID: "7e2581c9-1555-408f-81c8-4bbc2cdfcf50"). InnerVolumeSpecName "kube-api-access-wbctd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:15:54.932243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:54.932202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util" (OuterVolumeSpecName: "util") pod "7e2581c9-1555-408f-81c8-4bbc2cdfcf50" (UID: "7e2581c9-1555-408f-81c8-4bbc2cdfcf50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:15:55.029908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.029812    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:55.029908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.029844    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:55.029908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.029859    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbctd\" (UniqueName: \"kubernetes.io/projected/7e2581c9-1555-408f-81c8-4bbc2cdfcf50-kube-api-access-wbctd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:15:55.728805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.728772    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82"
Sep 15 21:15:55.728805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.728784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fslf82" event={"ID":"7e2581c9-1555-408f-81c8-4bbc2cdfcf50","Type":"ContainerDied","Data":"65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341"}
Sep 15 21:15:55.729054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:55.728839    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65318df3efded752e69a87e95fbe3d652f4ff6bc201e7136802416224e2f8341"
Sep 15 21:15:56.817611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:56.817563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:58.720464 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:15:58.720430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qt6lr"
Sep 15 21:16:03.681124 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:03.681082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:03.779074 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:03.779038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:10.454018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:10.453931    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:10.551756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:10.551722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:10.877671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:10.877608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:12.186623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:12.186574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:13.090018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.089968    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"]
Sep 15 21:16:13.090305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090290    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="extract"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090307    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="extract"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090323    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="pull"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090329    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="pull"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090337    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="util"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090343    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="util"
Sep 15 21:16:13.090399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.090392    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e2581c9-1555-408f-81c8-4bbc2cdfcf50" containerName="extract"
Sep 15 21:16:13.098647 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.098608    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.101923 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.101885    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 21:16:13.102096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.102004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9m6d\""
Sep 15 21:16:13.102300 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.102283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 21:16:13.103468 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.103443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"]
Sep 15 21:16:13.176335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.176290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pp8l\" (UniqueName: \"kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.176335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.176337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.176553 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.176478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.277897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.277855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.277897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.277900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pp8l\" (UniqueName: \"kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.278323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.277964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.278323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.278304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.278389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.278335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.287601 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.287576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pp8l\" (UniqueName: \"kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.410079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.410026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:13.681057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.681030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"]
Sep 15 21:16:13.683630 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:16:13.683595    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e34e9e_1356_40a5_8781_222b508d65c7.slice/crio-366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d WatchSource:0}: Error finding container 366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d: Status 404 returned error can't find the container with id 366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d
Sep 15 21:16:13.810574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.810539    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerID="e5041e942268b46022242bda2d89adffe29ecdf2bacf6693fa21f99b205f4514" exitCode=0
Sep 15 21:16:13.810722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.810629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g" event={"ID":"b3e34e9e-1356-40a5-8781-222b508d65c7","Type":"ContainerDied","Data":"e5041e942268b46022242bda2d89adffe29ecdf2bacf6693fa21f99b205f4514"}
Sep 15 21:16:13.810722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:13.810688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g" event={"ID":"b3e34e9e-1356-40a5-8781-222b508d65c7","Type":"ContainerStarted","Data":"366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d"}
Sep 15 21:16:14.816356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:14.816314    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerID="4acf0b27448fa7a581275f5ea92d95b3c77fdef222a44d249464ce38896f521e" exitCode=0
Sep 15 21:16:14.816777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:14.816399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g" event={"ID":"b3e34e9e-1356-40a5-8781-222b508d65c7","Type":"ContainerDied","Data":"4acf0b27448fa7a581275f5ea92d95b3c77fdef222a44d249464ce38896f521e"}
Sep 15 21:16:15.823251 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:15.823216    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerID="fbe0c2837c49a770fb2817f1d53fdb32bb346bf63133bf7c69db476fa6b5cca7" exitCode=0
Sep 15 21:16:15.823653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:15.823305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g" event={"ID":"b3e34e9e-1356-40a5-8781-222b508d65c7","Type":"ContainerDied","Data":"fbe0c2837c49a770fb2817f1d53fdb32bb346bf63133bf7c69db476fa6b5cca7"}
Sep 15 21:16:16.953345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:16.953315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:17.010100 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.010064    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle\") pod \"b3e34e9e-1356-40a5-8781-222b508d65c7\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") "
Sep 15 21:16:17.010269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.010150    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pp8l\" (UniqueName: \"kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l\") pod \"b3e34e9e-1356-40a5-8781-222b508d65c7\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") "
Sep 15 21:16:17.010269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.010183    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util\") pod \"b3e34e9e-1356-40a5-8781-222b508d65c7\" (UID: \"b3e34e9e-1356-40a5-8781-222b508d65c7\") "
Sep 15 21:16:17.010861 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.010830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle" (OuterVolumeSpecName: "bundle") pod "b3e34e9e-1356-40a5-8781-222b508d65c7" (UID: "b3e34e9e-1356-40a5-8781-222b508d65c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:16:17.012351 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.012326    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l" (OuterVolumeSpecName: "kube-api-access-4pp8l") pod "b3e34e9e-1356-40a5-8781-222b508d65c7" (UID: "b3e34e9e-1356-40a5-8781-222b508d65c7"). InnerVolumeSpecName "kube-api-access-4pp8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:16:17.016168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.016146    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util" (OuterVolumeSpecName: "util") pod "b3e34e9e-1356-40a5-8781-222b508d65c7" (UID: "b3e34e9e-1356-40a5-8781-222b508d65c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:16:17.110660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.110618    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:17.110660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.110655    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pp8l\" (UniqueName: \"kubernetes.io/projected/b3e34e9e-1356-40a5-8781-222b508d65c7-kube-api-access-4pp8l\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:17.110660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.110667    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3e34e9e-1356-40a5-8781-222b508d65c7-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:17.833777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.833741    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g"
Sep 15 21:16:17.833777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.833754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af86h6g" event={"ID":"b3e34e9e-1356-40a5-8781-222b508d65c7","Type":"ContainerDied","Data":"366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d"}
Sep 15 21:16:17.834024 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:17.833816    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="366c00e112299289c215ed4b6f88d8c59f730ad28db1c2d5b40e797ee4dc2a3d"
Sep 15 21:16:22.102368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:22.102325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:22.215427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:22.215389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:23.609781 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.609744    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"]
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610058    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="util"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610070    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="util"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610081    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="pull"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610089    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="pull"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610120    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="extract"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610129    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="extract"
Sep 15 21:16:23.610188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.610184    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e34e9e-1356-40a5-8781-222b508d65c7" containerName="extract"
Sep 15 21:16:23.612428 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.612410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.614969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.614945    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9m6d\""
Sep 15 21:16:23.615122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.615065    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 21:16:23.615970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.615953    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 21:16:23.625292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.625265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"]
Sep 15 21:16:23.769339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.769295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.769339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.769336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh59v\" (UniqueName: \"kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.769563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.769374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.870685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.870594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.870685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.870680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.870874 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.870703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh59v\" (UniqueName: \"kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.871033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.871009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.871073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.871044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.892066 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.892027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh59v\" (UniqueName: \"kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:23.922090 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:23.922052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:24.202850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.202822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"]
Sep 15 21:16:24.204918 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:16:24.204888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420db622_2dd2_4dd5_95be_518665625496.slice/crio-55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f WatchSource:0}: Error finding container 55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f: Status 404 returned error can't find the container with id 55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f
Sep 15 21:16:24.285117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.285075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.380261 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.380228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.828688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.828650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.866960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.866897    2560 generic.go:356] "Generic (PLEG): container finished" podID="420db622-2dd2-4dd5-95be-518665625496" containerID="aee4107c55e0ee0e28d41fe55238c3f03739e4351da7e7852c3803c774a4f9a3" exitCode=0
Sep 15 21:16:24.867126 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.866984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerDied","Data":"aee4107c55e0ee0e28d41fe55238c3f03739e4351da7e7852c3803c774a4f9a3"}
Sep 15 21:16:24.867126 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:24.867033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerStarted","Data":"55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f"}
Sep 15 21:16:25.112075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.112039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.214656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.214620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.274221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.274180    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"]
Sep 15 21:16:25.276696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.276675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.280819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.280790    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 21:16:25.280819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.280789    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 21:16:25.281061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.280790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 21:16:25.281061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.280868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2xlj\""
Sep 15 21:16:25.281061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.280884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 21:16:25.301768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.301729    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"]
Sep 15 21:16:25.383390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.383293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-webhook-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.383390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.383334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-manifests\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.383390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.383355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frcql\" (UniqueName: \"kubernetes.io/projected/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-kube-api-access-frcql\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.383637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.383441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.383637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.383490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-tmp\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.428215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.428176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.484581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.484539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-webhook-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.484785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.484587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-manifests\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.484785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.484714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frcql\" (UniqueName: \"kubernetes.io/projected/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-kube-api-access-frcql\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.484785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.484764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.484978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.484815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-tmp\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.485076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.485054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-manifests\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.487117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.487084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-tmp\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.487224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.487158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-webhook-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.487224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.487216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.492559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.492538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frcql\" (UniqueName: \"kubernetes.io/projected/c7beb9f3-3ea5-4ff1-9263-7806b545ea10-kube-api-access-frcql\") pod \"opendatahub-operator-controller-manager-546ffd48db-zqnt9\" (UID: \"c7beb9f3-3ea5-4ff1-9263-7806b545ea10\") " pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.530329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.530296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.587252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.587194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:25.628989 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.628952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.732547 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.732509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.847239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.847179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:25.921416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:25.921385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"]
Sep 15 21:16:25.923896 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:16:25.923866    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7beb9f3_3ea5_4ff1_9263_7806b545ea10.slice/crio-a751aa74cc2d286ec12f3180ce89f81c153032df16f484587f663c3433802697 WatchSource:0}: Error finding container a751aa74cc2d286ec12f3180ce89f81c153032df16f484587f663c3433802697: Status 404 returned error can't find the container with id a751aa74cc2d286ec12f3180ce89f81c153032df16f484587f663c3433802697
Sep 15 21:16:26.880418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:26.880364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9" event={"ID":"c7beb9f3-3ea5-4ff1-9263-7806b545ea10","Type":"ContainerStarted","Data":"a751aa74cc2d286ec12f3180ce89f81c153032df16f484587f663c3433802697"}
Sep 15 21:16:26.882958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:26.882900    2560 generic.go:356] "Generic (PLEG): container finished" podID="420db622-2dd2-4dd5-95be-518665625496" containerID="f6e120de5c91571562c67546bfaa47aab292012070f4c7671b426f0f77b2742a" exitCode=0
Sep 15 21:16:26.883112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:26.883024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerDied","Data":"f6e120de5c91571562c67546bfaa47aab292012070f4c7671b426f0f77b2742a"}
Sep 15 21:16:27.891971 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:27.891913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerStarted","Data":"675236b308cd8e02f03cbc48025f79385ba6d5aeab8f96c860f5631a1509a17c"}
Sep 15 21:16:27.911425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:27.911365    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" podStartSLOduration=3.092580706 podStartE2EDuration="4.911342118s" totalImagesPullingTime="1.818761412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:27.909673206 +0000 UTC m=+482.313995255" watchObservedRunningTime="2026-09-15 21:16:27.911342118 +0000 UTC m=+482.315664166"
Sep 15 21:16:28.898856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:28.898768    2560 generic.go:356] "Generic (PLEG): container finished" podID="420db622-2dd2-4dd5-95be-518665625496" containerID="675236b308cd8e02f03cbc48025f79385ba6d5aeab8f96c860f5631a1509a17c" exitCode=0
Sep 15 21:16:28.898856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:28.898831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerDied","Data":"675236b308cd8e02f03cbc48025f79385ba6d5aeab8f96c860f5631a1509a17c"}
Sep 15 21:16:28.900737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:28.900710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9" event={"ID":"c7beb9f3-3ea5-4ff1-9263-7806b545ea10","Type":"ContainerStarted","Data":"44e77333901aa21eb18d9f4bc03bf0dc74c43ed7e0b9ce5ea15da8030f68f116"}
Sep 15 21:16:29.907676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:29.907639    2560 generic.go:356] "Generic (PLEG): container finished" podID="c7beb9f3-3ea5-4ff1-9263-7806b545ea10" containerID="44e77333901aa21eb18d9f4bc03bf0dc74c43ed7e0b9ce5ea15da8030f68f116" exitCode=0
Sep 15 21:16:29.908075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:29.907722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9" event={"ID":"c7beb9f3-3ea5-4ff1-9263-7806b545ea10","Type":"ContainerDied","Data":"44e77333901aa21eb18d9f4bc03bf0dc74c43ed7e0b9ce5ea15da8030f68f116"}
Sep 15 21:16:30.037021 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.036993    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:30.122674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.122640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle\") pod \"420db622-2dd2-4dd5-95be-518665625496\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") "
Sep 15 21:16:30.122872 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.122759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util\") pod \"420db622-2dd2-4dd5-95be-518665625496\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") "
Sep 15 21:16:30.122872 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.122812    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh59v\" (UniqueName: \"kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v\") pod \"420db622-2dd2-4dd5-95be-518665625496\" (UID: \"420db622-2dd2-4dd5-95be-518665625496\") "
Sep 15 21:16:30.123452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.123416    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle" (OuterVolumeSpecName: "bundle") pod "420db622-2dd2-4dd5-95be-518665625496" (UID: "420db622-2dd2-4dd5-95be-518665625496"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:16:30.124908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.124882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v" (OuterVolumeSpecName: "kube-api-access-zh59v") pod "420db622-2dd2-4dd5-95be-518665625496" (UID: "420db622-2dd2-4dd5-95be-518665625496"). InnerVolumeSpecName "kube-api-access-zh59v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:16:30.127791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.127761    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util" (OuterVolumeSpecName: "util") pod "420db622-2dd2-4dd5-95be-518665625496" (UID: "420db622-2dd2-4dd5-95be-518665625496"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:16:30.223637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.223596    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh59v\" (UniqueName: \"kubernetes.io/projected/420db622-2dd2-4dd5-95be-518665625496-kube-api-access-zh59v\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:30.223637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.223625    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:30.223637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.223633    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/420db622-2dd2-4dd5-95be-518665625496-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:16:30.914655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.914610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9" event={"ID":"c7beb9f3-3ea5-4ff1-9263-7806b545ea10","Type":"ContainerStarted","Data":"6a237e6241fbd122c9405552f5930a5a7d209b1391880991c241d8b6e945b323"}
Sep 15 21:16:30.915182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.914716    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:30.917241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.917211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn" event={"ID":"420db622-2dd2-4dd5-95be-518665625496","Type":"ContainerDied","Data":"55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f"}
Sep 15 21:16:30.917241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.917241    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0drjrn"
Sep 15 21:16:30.917490 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.917262    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55e872cd93561635ddf419fe3d2f9efcde38c2960750c6521bfd9542e470049f"
Sep 15 21:16:30.945146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:30.945088    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9" podStartSLOduration=1.760890203 podStartE2EDuration="5.945070004s" totalImagesPullingTime="3.091922037s" totalInitContainerRuntime="1.092257764s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:30.944288307 +0000 UTC m=+485.348610353" watchObservedRunningTime="2026-09-15 21:16:30.945070004 +0000 UTC m=+485.349392051"
Sep 15 21:16:36.388505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:36.388468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:36.504329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:36.504294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:41.924808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:41.924773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546ffd48db-zqnt9"
Sep 15 21:16:44.617292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:44.617252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:45.189694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.189657    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"]
Sep 15 21:16:45.189988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.189975    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="extract"
Sep 15 21:16:45.190045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.189989    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="extract"
Sep 15 21:16:45.190045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.190006    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="pull"
Sep 15 21:16:45.190045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.190011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="pull"
Sep 15 21:16:45.190045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.190027    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="util"
Sep 15 21:16:45.190045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.190033    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="util"
Sep 15 21:16:45.190196 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.190088    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="420db622-2dd2-4dd5-95be-518665625496" containerName="extract"
Sep 15 21:16:45.200061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.200034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.220334 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.220298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 21:16:45.220590 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.220569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kcm72\""
Sep 15 21:16:45.220892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.220874    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 21:16:45.221651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.221628    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 21:16:45.221651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.221644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:16:45.221795 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.221672    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 21:16:45.224246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.224224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"]
Sep 15 21:16:45.277106 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.277074    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"]
Sep 15 21:16:45.279499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.279472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.285800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.285776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zx8xv\""
Sep 15 21:16:45.286158 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.286094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 21:16:45.287181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.287162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 21:16:45.315916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.315884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"]
Sep 15 21:16:45.353979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.353928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bc045c0-829f-40b1-ab53-e5e9b1901428-manager-config\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.354145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.353986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-metrics-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.354145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.354017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.354145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.354092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5fsp\" (UniqueName: \"kubernetes.io/projected/0bc045c0-829f-40b1-ab53-e5e9b1901428-kube-api-access-n5fsp\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.454820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.454721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbbeb89-a80b-4b14-858e-8da12f90b324-tmp\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.454820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.454776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5fsp\" (UniqueName: \"kubernetes.io/projected/0bc045c0-829f-40b1-ab53-e5e9b1901428-kube-api-access-n5fsp\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.455107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.454875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbbeb89-a80b-4b14-858e-8da12f90b324-tls-certs\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.455107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.454966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bc045c0-829f-40b1-ab53-e5e9b1901428-manager-config\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.455107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.454992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-metrics-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.455107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.455018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s9v5\" (UniqueName: \"kubernetes.io/projected/dcbbeb89-a80b-4b14-858e-8da12f90b324-kube-api-access-8s9v5\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.455107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.455065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.455629 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.455609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0bc045c0-829f-40b1-ab53-e5e9b1901428-manager-config\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.457602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.457580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.457697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.457617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0bc045c0-829f-40b1-ab53-e5e9b1901428-metrics-cert\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.476081 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.476051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5fsp\" (UniqueName: \"kubernetes.io/projected/0bc045c0-829f-40b1-ab53-e5e9b1901428-kube-api-access-n5fsp\") pod \"lws-controller-manager-68888cf94f-p6s7f\" (UID: \"0bc045c0-829f-40b1-ab53-e5e9b1901428\") " pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.509700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.509654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:45.556278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.556237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbbeb89-a80b-4b14-858e-8da12f90b324-tls-certs\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.556469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.556300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s9v5\" (UniqueName: \"kubernetes.io/projected/dcbbeb89-a80b-4b14-858e-8da12f90b324-kube-api-access-8s9v5\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.556469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.556353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbbeb89-a80b-4b14-858e-8da12f90b324-tmp\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.559191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.559134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbbeb89-a80b-4b14-858e-8da12f90b324-tmp\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.559894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.559521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbbeb89-a80b-4b14-858e-8da12f90b324-tls-certs\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.577599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.577561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s9v5\" (UniqueName: \"kubernetes.io/projected/dcbbeb89-a80b-4b14-858e-8da12f90b324-kube-api-access-8s9v5\") pod \"kube-auth-proxy-695d9b6867-tlkpz\" (UID: \"dcbbeb89-a80b-4b14-858e-8da12f90b324\") " pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.589720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.589685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"
Sep 15 21:16:45.800442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.800413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"]
Sep 15 21:16:45.802733 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:16:45.802704    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc045c0_829f_40b1_ab53_e5e9b1901428.slice/crio-cf1ff5cc2448a928b18611b25b5aa0ea5ef8aad4ced656c8a61d3d2557572f0d WatchSource:0}: Error finding container cf1ff5cc2448a928b18611b25b5aa0ea5ef8aad4ced656c8a61d3d2557572f0d: Status 404 returned error can't find the container with id cf1ff5cc2448a928b18611b25b5aa0ea5ef8aad4ced656c8a61d3d2557572f0d
Sep 15 21:16:45.886114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.886084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz"]
Sep 15 21:16:45.888013 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:16:45.887981    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbbeb89_a80b_4b14_858e_8da12f90b324.slice/crio-204cf6e06477f9ccb77186efb89fadf16b42fde667d4cf2b600d5e5d66ab391f WatchSource:0}: Error finding container 204cf6e06477f9ccb77186efb89fadf16b42fde667d4cf2b600d5e5d66ab391f: Status 404 returned error can't find the container with id 204cf6e06477f9ccb77186efb89fadf16b42fde667d4cf2b600d5e5d66ab391f
Sep 15 21:16:45.992511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.992464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz" event={"ID":"dcbbeb89-a80b-4b14-858e-8da12f90b324","Type":"ContainerStarted","Data":"204cf6e06477f9ccb77186efb89fadf16b42fde667d4cf2b600d5e5d66ab391f"}
Sep 15 21:16:45.993765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:45.993736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f" event={"ID":"0bc045c0-829f-40b1-ab53-e5e9b1901428","Type":"ContainerStarted","Data":"cf1ff5cc2448a928b18611b25b5aa0ea5ef8aad4ced656c8a61d3d2557572f0d"}
Sep 15 21:16:46.170432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:46.170396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:46.262482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:46.262445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:47.759895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:47.759853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:47.898220 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:47.898176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:49.016581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.016532    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz" event={"ID":"dcbbeb89-a80b-4b14-858e-8da12f90b324","Type":"ContainerStarted","Data":"a1c95be5147fb7f4c82a0f532cf911959a3b68c33f079f7a04154f9ae58e5e89"}
Sep 15 21:16:49.018136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.018112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f" event={"ID":"0bc045c0-829f-40b1-ab53-e5e9b1901428","Type":"ContainerStarted","Data":"24b102e7e833906f31035d3822b1e808c681dc06573707d04d6bbe8d2fbc22ba"}
Sep 15 21:16:49.018256 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.018241    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:16:49.034715 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.034665    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-695d9b6867-tlkpz" podStartSLOduration=1.050638081 podStartE2EDuration="4.034647685s" totalImagesPullingTime="2.984009604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:49.033350969 +0000 UTC m=+503.437673016" watchObservedRunningTime="2026-09-15 21:16:49.034647685 +0000 UTC m=+503.438969731"
Sep 15 21:16:49.052536 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.052481    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f" podStartSLOduration=1.012739319 podStartE2EDuration="4.052465754s" totalImagesPullingTime="3.039726435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:49.05154771 +0000 UTC m=+503.455869768" watchObservedRunningTime="2026-09-15 21:16:49.052465754 +0000 UTC m=+503.456787800"
Sep 15 21:16:49.053882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.053853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:49.786627 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:49.786595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:52.002646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:52.002607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:52.104054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:52.104018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:52.509644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:52.509602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:54.166466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:54.166428    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:54.267445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:54.267415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.029454 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:56.029415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.158171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:56.158136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.299125 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:56.299032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.559232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:56.559139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.785592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:16:56.785560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:00.026434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:00.026400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68888cf94f-p6s7f"
Sep 15 21:17:02.346623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:02.346583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:02.579639 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:02.579605    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:04.236160 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:04.236128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:04.340179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:04.340139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:06.268817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:06.268777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:06.376150 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:06.376115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:06.456921 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:06.456880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:06.637738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:06.637680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:07.635194 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:07.635146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:07.819602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:07.819550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:46.522585 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:46.522544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:46.624168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:46.624130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:57.072357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:57.072317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:57.169461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:17:57.169416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:01.603580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.603536    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"]
Sep 15 21:18:01.606173 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.606150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.608889 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.608863    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9m6d\""
Sep 15 21:18:01.608889 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.608879    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 21:18:01.609791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.609771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 21:18:01.615744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.615722    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"]
Sep 15 21:18:01.695774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.695734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.695774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.695771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.696051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.695805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8d7\" (UniqueName: \"kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.699906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.699872    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"]
Sep 15 21:18:01.702501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.702481    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.711739 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.711711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"]
Sep 15 21:18:01.797007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.796967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.797007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.797243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8d7\" (UniqueName: \"kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.797243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxnf\" (UniqueName: \"kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.797243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.797357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.797357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.797442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.797388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.804907 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.804873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"]
Sep 15 21:18:01.807791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.807771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.812257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.812235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8d7\" (UniqueName: \"kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.822918 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.822895    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"]
Sep 15 21:18:01.898403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.898403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.898825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssp4v\" (UniqueName: \"kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.898825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.898825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxnf\" (UniqueName: \"kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.898825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.899061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.899061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.898930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.915271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.915237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:01.918435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.918199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxnf\" (UniqueName: \"kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:01.918435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.918379    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"]
Sep 15 21:18:01.921211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.921190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:01.933532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.933503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"]
Sep 15 21:18:01.999540 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.999717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:01.999717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.999717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27vtn\" (UniqueName: \"kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:01.999717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:01.999924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssp4v\" (UniqueName: \"kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.999983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:01.999983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:01.999959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:02.009371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.009336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssp4v\" (UniqueName: \"kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:02.012115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.012091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:02.100692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.100649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.100913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.100848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27vtn\" (UniqueName: \"kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.101030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.100985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.101129 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.101107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.101277 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.101257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.111704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.111672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27vtn\" (UniqueName: \"kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.123496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.123458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:02.197001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.196976    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"]
Sep 15 21:18:02.199638 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:02.199607    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba8bff1_1931_48fa_8920_e581b7f1858e.slice/crio-99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268 WatchSource:0}: Error finding container 99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268: Status 404 returned error can't find the container with id 99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268
Sep 15 21:18:02.250863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.250835    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:02.288496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.288463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"]
Sep 15 21:18:02.292284 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:02.292224    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18443b7_8698_4001_9876_0e58cbe90b4c.slice/crio-0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1 WatchSource:0}: Error finding container 0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1: Status 404 returned error can't find the container with id 0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1
Sep 15 21:18:02.363660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.363626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm" event={"ID":"a18443b7-8698-4001-9876-0e58cbe90b4c","Type":"ContainerStarted","Data":"0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1"}
Sep 15 21:18:02.365152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.365123    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerID="b2de0e35d0ead39cb436b6c822395f8f37435d4a170036ec115745dd7cd38f88" exitCode=0
Sep 15 21:18:02.365280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.365185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx" event={"ID":"9ba8bff1-1931-48fa-8920-e581b7f1858e","Type":"ContainerDied","Data":"b2de0e35d0ead39cb436b6c822395f8f37435d4a170036ec115745dd7cd38f88"}
Sep 15 21:18:02.365280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.365215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx" event={"ID":"9ba8bff1-1931-48fa-8920-e581b7f1858e","Type":"ContainerStarted","Data":"99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268"}
Sep 15 21:18:02.410275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.410228    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"]
Sep 15 21:18:02.412376 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:02.412346    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc69e695_8234_4485_9860_9849569b7fdf.slice/crio-804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f WatchSource:0}: Error finding container 804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f: Status 404 returned error can't find the container with id 804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f
Sep 15 21:18:02.529948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:02.529909    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"]
Sep 15 21:18:02.531881 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:02.531852    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655211ce_b6a3_4d5e_b6fe_3a728c70a686.slice/crio-efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40 WatchSource:0}: Error finding container efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40: Status 404 returned error can't find the container with id efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40
Sep 15 21:18:03.371796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.371756    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc69e695-8234-4485-9860-9849569b7fdf" containerID="7f088253d8d530af3e300b4f1a650a1740879f1506e1d1ec08d0620ae9a26fa8" exitCode=0
Sep 15 21:18:03.372279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.371844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q" event={"ID":"bc69e695-8234-4485-9860-9849569b7fdf","Type":"ContainerDied","Data":"7f088253d8d530af3e300b4f1a650a1740879f1506e1d1ec08d0620ae9a26fa8"}
Sep 15 21:18:03.372279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.371985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q" event={"ID":"bc69e695-8234-4485-9860-9849569b7fdf","Type":"ContainerStarted","Data":"804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f"}
Sep 15 21:18:03.373575 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.373554    2560 generic.go:356] "Generic (PLEG): container finished" podID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerID="60a2da75fb455dbec720ea64aee51ca8c32516f3ed11f478b3c7f08ecadf23b7" exitCode=0
Sep 15 21:18:03.373664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.373638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm" event={"ID":"a18443b7-8698-4001-9876-0e58cbe90b4c","Type":"ContainerDied","Data":"60a2da75fb455dbec720ea64aee51ca8c32516f3ed11f478b3c7f08ecadf23b7"}
Sep 15 21:18:03.375797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.375778    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerID="7b25ba7185adcc0a9e5ec47e68f6f572a19614659277e0793000c3b3cb7d15a5" exitCode=0
Sep 15 21:18:03.375882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.375854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx" event={"ID":"9ba8bff1-1931-48fa-8920-e581b7f1858e","Type":"ContainerDied","Data":"7b25ba7185adcc0a9e5ec47e68f6f572a19614659277e0793000c3b3cb7d15a5"}
Sep 15 21:18:03.377544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.377517    2560 generic.go:356] "Generic (PLEG): container finished" podID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerID="d556999320062b0d7a202ca919fea9976ad5a930fcbf2a7d3b67fbeccbf3f13a" exitCode=0
Sep 15 21:18:03.377622 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.377558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v" event={"ID":"655211ce-b6a3-4d5e-b6fe-3a728c70a686","Type":"ContainerDied","Data":"d556999320062b0d7a202ca919fea9976ad5a930fcbf2a7d3b67fbeccbf3f13a"}
Sep 15 21:18:03.377622 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:03.377592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v" event={"ID":"655211ce-b6a3-4d5e-b6fe-3a728c70a686","Type":"ContainerStarted","Data":"efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40"}
Sep 15 21:18:04.384714 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.384675    2560 generic.go:356] "Generic (PLEG): container finished" podID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerID="459cafa125b720e0e0a478af065fdcd7a5c028f27ed6c05ca0c39198beae1df7" exitCode=0
Sep 15 21:18:04.385226 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.384754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v" event={"ID":"655211ce-b6a3-4d5e-b6fe-3a728c70a686","Type":"ContainerDied","Data":"459cafa125b720e0e0a478af065fdcd7a5c028f27ed6c05ca0c39198beae1df7"}
Sep 15 21:18:04.386793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.386771    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc69e695-8234-4485-9860-9849569b7fdf" containerID="91e0563c7e6845abee18264c006d365f59153379f9903673619f28b6e896ef6c" exitCode=0
Sep 15 21:18:04.386870 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.386853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q" event={"ID":"bc69e695-8234-4485-9860-9849569b7fdf","Type":"ContainerDied","Data":"91e0563c7e6845abee18264c006d365f59153379f9903673619f28b6e896ef6c"}
Sep 15 21:18:04.388806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.388768    2560 generic.go:356] "Generic (PLEG): container finished" podID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerID="093793fc3aaa1bce29bc951f684dea84aa3d1c3fdde5b964500b2575ee29361e" exitCode=0
Sep 15 21:18:04.388898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.388852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm" event={"ID":"a18443b7-8698-4001-9876-0e58cbe90b4c","Type":"ContainerDied","Data":"093793fc3aaa1bce29bc951f684dea84aa3d1c3fdde5b964500b2575ee29361e"}
Sep 15 21:18:04.391460 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.391438    2560 generic.go:356] "Generic (PLEG): container finished" podID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerID="5dac2695ce3e5fad02925ac38912f5a393fa26f980f4e4f233a5a145d2a531f7" exitCode=0
Sep 15 21:18:04.391532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:04.391472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx" event={"ID":"9ba8bff1-1931-48fa-8920-e581b7f1858e","Type":"ContainerDied","Data":"5dac2695ce3e5fad02925ac38912f5a393fa26f980f4e4f233a5a145d2a531f7"}
Sep 15 21:18:05.398953 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.398898    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc69e695-8234-4485-9860-9849569b7fdf" containerID="b2158921d01b0f84d649aee2f46223066bedd11325097d4aa9ac4b2e9598b166" exitCode=0
Sep 15 21:18:05.399324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.398976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q" event={"ID":"bc69e695-8234-4485-9860-9849569b7fdf","Type":"ContainerDied","Data":"b2158921d01b0f84d649aee2f46223066bedd11325097d4aa9ac4b2e9598b166"}
Sep 15 21:18:05.401159 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.401134    2560 generic.go:356] "Generic (PLEG): container finished" podID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerID="562aeeb1f96ef1afeb794148b032bea7f691418fa731d6639bfcea6196160172" exitCode=0
Sep 15 21:18:05.401282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.401213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm" event={"ID":"a18443b7-8698-4001-9876-0e58cbe90b4c","Type":"ContainerDied","Data":"562aeeb1f96ef1afeb794148b032bea7f691418fa731d6639bfcea6196160172"}
Sep 15 21:18:05.403193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.403162    2560 generic.go:356] "Generic (PLEG): container finished" podID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerID="81d235c696f24585245f7bdc119a28cb197ef61f0704012008818bf64a426221" exitCode=0
Sep 15 21:18:05.403193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.403187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v" event={"ID":"655211ce-b6a3-4d5e-b6fe-3a728c70a686","Type":"ContainerDied","Data":"81d235c696f24585245f7bdc119a28cb197ef61f0704012008818bf64a426221"}
Sep 15 21:18:05.529337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.529312    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:05.633738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.633698    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle\") pod \"9ba8bff1-1931-48fa-8920-e581b7f1858e\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") "
Sep 15 21:18:05.633738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.633742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt8d7\" (UniqueName: \"kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7\") pod \"9ba8bff1-1931-48fa-8920-e581b7f1858e\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") "
Sep 15 21:18:05.634020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.633805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util\") pod \"9ba8bff1-1931-48fa-8920-e581b7f1858e\" (UID: \"9ba8bff1-1931-48fa-8920-e581b7f1858e\") "
Sep 15 21:18:05.634254 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.634223    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle" (OuterVolumeSpecName: "bundle") pod "9ba8bff1-1931-48fa-8920-e581b7f1858e" (UID: "9ba8bff1-1931-48fa-8920-e581b7f1858e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:05.635907 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.635876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7" (OuterVolumeSpecName: "kube-api-access-pt8d7") pod "9ba8bff1-1931-48fa-8920-e581b7f1858e" (UID: "9ba8bff1-1931-48fa-8920-e581b7f1858e"). InnerVolumeSpecName "kube-api-access-pt8d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:18:05.639101 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.639078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util" (OuterVolumeSpecName: "util") pod "9ba8bff1-1931-48fa-8920-e581b7f1858e" (UID: "9ba8bff1-1931-48fa-8920-e581b7f1858e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:05.734996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.734890    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:05.734996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.734920    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ba8bff1-1931-48fa-8920-e581b7f1858e-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:05.734996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:05.734930    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt8d7\" (UniqueName: \"kubernetes.io/projected/9ba8bff1-1931-48fa-8920-e581b7f1858e-kube-api-access-pt8d7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.410403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.410368    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx"
Sep 15 21:18:06.410768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.410399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6898mx" event={"ID":"9ba8bff1-1931-48fa-8920-e581b7f1858e","Type":"ContainerDied","Data":"99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268"}
Sep 15 21:18:06.410768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.410460    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99a1db8f3f7bf696bef2f05495a2d0b1c645589a578f738a0139203d948a0268"
Sep 15 21:18:06.565877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.565849    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:06.600165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.600128    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:06.603218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.603196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:06.643589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssp4v\" (UniqueName: \"kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v\") pod \"bc69e695-8234-4485-9860-9849569b7fdf\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") "
Sep 15 21:18:06.643758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643612    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util\") pod \"a18443b7-8698-4001-9876-0e58cbe90b4c\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") "
Sep 15 21:18:06.643758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643656    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util\") pod \"bc69e695-8234-4485-9860-9849569b7fdf\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") "
Sep 15 21:18:06.643758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scxnf\" (UniqueName: \"kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf\") pod \"a18443b7-8698-4001-9876-0e58cbe90b4c\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") "
Sep 15 21:18:06.643758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27vtn\" (UniqueName: \"kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn\") pod \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") "
Sep 15 21:18:06.643758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643741    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle\") pod \"bc69e695-8234-4485-9860-9849569b7fdf\" (UID: \"bc69e695-8234-4485-9860-9849569b7fdf\") "
Sep 15 21:18:06.644057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643768    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle\") pod \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") "
Sep 15 21:18:06.644057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle\") pod \"a18443b7-8698-4001-9876-0e58cbe90b4c\" (UID: \"a18443b7-8698-4001-9876-0e58cbe90b4c\") "
Sep 15 21:18:06.644057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.643820    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util\") pod \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\" (UID: \"655211ce-b6a3-4d5e-b6fe-3a728c70a686\") "
Sep 15 21:18:06.644963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.644901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle" (OuterVolumeSpecName: "bundle") pod "bc69e695-8234-4485-9860-9849569b7fdf" (UID: "bc69e695-8234-4485-9860-9849569b7fdf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.645695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.645666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle" (OuterVolumeSpecName: "bundle") pod "655211ce-b6a3-4d5e-b6fe-3a728c70a686" (UID: "655211ce-b6a3-4d5e-b6fe-3a728c70a686"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.646725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.646677    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle" (OuterVolumeSpecName: "bundle") pod "a18443b7-8698-4001-9876-0e58cbe90b4c" (UID: "a18443b7-8698-4001-9876-0e58cbe90b4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.646725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.646703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf" (OuterVolumeSpecName: "kube-api-access-scxnf") pod "a18443b7-8698-4001-9876-0e58cbe90b4c" (UID: "a18443b7-8698-4001-9876-0e58cbe90b4c"). InnerVolumeSpecName "kube-api-access-scxnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:18:06.650612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.650556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v" (OuterVolumeSpecName: "kube-api-access-ssp4v") pod "bc69e695-8234-4485-9860-9849569b7fdf" (UID: "bc69e695-8234-4485-9860-9849569b7fdf"). InnerVolumeSpecName "kube-api-access-ssp4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:18:06.652278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.652246    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn" (OuterVolumeSpecName: "kube-api-access-27vtn") pod "655211ce-b6a3-4d5e-b6fe-3a728c70a686" (UID: "655211ce-b6a3-4d5e-b6fe-3a728c70a686"). InnerVolumeSpecName "kube-api-access-27vtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:18:06.652278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.652187    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util" (OuterVolumeSpecName: "util") pod "bc69e695-8234-4485-9860-9849569b7fdf" (UID: "bc69e695-8234-4485-9860-9849569b7fdf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.652644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.652627    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util" (OuterVolumeSpecName: "util") pod "655211ce-b6a3-4d5e-b6fe-3a728c70a686" (UID: "655211ce-b6a3-4d5e-b6fe-3a728c70a686"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.652928 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.652902    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util" (OuterVolumeSpecName: "util") pod "a18443b7-8698-4001-9876-0e58cbe90b4c" (UID: "a18443b7-8698-4001-9876-0e58cbe90b4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744625    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scxnf\" (UniqueName: \"kubernetes.io/projected/a18443b7-8698-4001-9876-0e58cbe90b4c-kube-api-access-scxnf\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744659    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27vtn\" (UniqueName: \"kubernetes.io/projected/655211ce-b6a3-4d5e-b6fe-3a728c70a686-kube-api-access-27vtn\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744672    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744685    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744695    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744703    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655211ce-b6a3-4d5e-b6fe-3a728c70a686-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744716    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssp4v\" (UniqueName: \"kubernetes.io/projected/bc69e695-8234-4485-9860-9849569b7fdf-kube-api-access-ssp4v\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.744733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744735    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18443b7-8698-4001-9876-0e58cbe90b4c-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:06.745177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:06.744745    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc69e695-8234-4485-9860-9849569b7fdf-util\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:18:07.417430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.417391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm" event={"ID":"a18443b7-8698-4001-9876-0e58cbe90b4c","Type":"ContainerDied","Data":"0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1"}
Sep 15 21:18:07.417898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.417433    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mnxhm"
Sep 15 21:18:07.417898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.417440    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd1381f75018ec6b0f5387fffcffc90617157f927ab1256b4caa281457363b1"
Sep 15 21:18:07.419333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.419314    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v"
Sep 15 21:18:07.419333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.419323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chzx8v" event={"ID":"655211ce-b6a3-4d5e-b6fe-3a728c70a686","Type":"ContainerDied","Data":"efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40"}
Sep 15 21:18:07.419491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.419360    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa67ec532d8044b749c5df98bf6792b800c0beda57771b947e75ee8a7db9d40"
Sep 15 21:18:07.421257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.421232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q" event={"ID":"bc69e695-8234-4485-9860-9849569b7fdf","Type":"ContainerDied","Data":"804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f"}
Sep 15 21:18:07.421364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.421273    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="804deb5315e2775cc519e156b0ea205bed76e7b9b3cc2c82dac5f0e17965653f"
Sep 15 21:18:07.421364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:07.421322    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw6r7q"
Sep 15 21:18:10.714163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:10.714124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:12.536358 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:12.536318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.390546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:15.390506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.714258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:15.714175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:17.336644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:17.336604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:17.547500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:17.547461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:17.699192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:17.699159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:20.290729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:20.290694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:20.541276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:20.541195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:20.653178 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:20.653146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:22.374223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.374186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:22.862380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.862332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:22.874625 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874594    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"]
Sep 15 21:18:22.874978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874961    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="pull"
Sep 15 21:18:22.874978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874978    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874987    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874992    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.874998    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="extract"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875003    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="extract"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875016    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875021    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875029    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875033    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875041    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875046    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875054    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875058    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875065    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875069    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="pull"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875075    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="extract"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875080    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="extract"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875088    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875093    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="util"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875099    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="extract"
Sep 15 21:18:22.875094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875104    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875109    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875114    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875160    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="655211ce-b6a3-4d5e-b6fe-3a728c70a686" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875167    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18443b7-8698-4001-9876-0e58cbe90b4c" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875172    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc69e695-8234-4485-9860-9849569b7fdf" containerName="extract"
Sep 15 21:18:22.876007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.875179    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba8bff1-1931-48fa-8920-e581b7f1858e" containerName="extract"
Sep 15 21:18:22.878155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.878134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:22.880683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.880660    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 15 21:18:22.880824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.880698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 15 21:18:22.882141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.882123    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 21:18:22.882235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.882199    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 21:18:22.882330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.882316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tf8sz\""
Sep 15 21:18:22.888291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.888268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"]
Sep 15 21:18:22.989046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.988979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnzgz\" (UniqueName: \"kubernetes.io/projected/4c479125-0a12-4100-bf67-4af100781ac2-kube-api-access-tnzgz\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:22.989239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.989078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c479125-0a12-4100-bf67-4af100781ac2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:22.989239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:22.989145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.090184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.090130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnzgz\" (UniqueName: \"kubernetes.io/projected/4c479125-0a12-4100-bf67-4af100781ac2-kube-api-access-tnzgz\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.090392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.090198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c479125-0a12-4100-bf67-4af100781ac2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.090392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.090259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.090392 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:18:23.090377    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 15 21:18:23.090570 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:18:23.090455    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert podName:4c479125-0a12-4100-bf67-4af100781ac2 nodeName:}" failed. No retries permitted until 2026-09-15 21:18:23.590434995 +0000 UTC m=+597.994757023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6lklj" (UID: "4c479125-0a12-4100-bf67-4af100781ac2") : secret "plugin-serving-cert" not found
Sep 15 21:18:23.090858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.090836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c479125-0a12-4100-bf67-4af100781ac2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.110313 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.110276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnzgz\" (UniqueName: \"kubernetes.io/projected/4c479125-0a12-4100-bf67-4af100781ac2-kube-api-access-tnzgz\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.204906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.204812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:23.595458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.595363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.597808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.597778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c479125-0a12-4100-bf67-4af100781ac2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6lklj\" (UID: \"4c479125-0a12-4100-bf67-4af100781ac2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:23.788422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:23.788382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"
Sep 15 21:18:24.061813 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:24.061782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj"]
Sep 15 21:18:24.063714 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:24.063689    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c479125_0a12_4100_bf67_4af100781ac2.slice/crio-12a5ace5c7ffe072e53c86279c9e7550919da4d9a36ad0ba84dbadbbeb312a50 WatchSource:0}: Error finding container 12a5ace5c7ffe072e53c86279c9e7550919da4d9a36ad0ba84dbadbbeb312a50: Status 404 returned error can't find the container with id 12a5ace5c7ffe072e53c86279c9e7550919da4d9a36ad0ba84dbadbbeb312a50
Sep 15 21:18:24.514243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:24.514204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj" event={"ID":"4c479125-0a12-4100-bf67-4af100781ac2","Type":"ContainerStarted","Data":"12a5ace5c7ffe072e53c86279c9e7550919da4d9a36ad0ba84dbadbbeb312a50"}
Sep 15 21:18:25.893517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:25.893476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:25.946376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:25.946338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.056112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.056083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:18:26.056297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.056281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:18:26.301269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.301168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.403413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.403377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.692287 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.692251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.810427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:26.810382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:28.400725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.400674    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d564cfd4d-t459t"]
Sep 15 21:18:28.408292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.408264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.410994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.410963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 21:18:28.412217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.412040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 21:18:28.412217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.412063    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 21:18:28.413677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.412873    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 21:18:28.414152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.412798    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2wzw\""
Sep 15 21:18:28.415623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.414600    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 21:18:28.420189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.419401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d564cfd4d-t459t"]
Sep 15 21:18:28.420189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.419505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 21:18:28.466743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.466696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:28.541535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rvs\" (UniqueName: \"kubernetes.io/projected/3012b8e4-61d0-4abb-91e3-4fb62a89464d-kube-api-access-r4rvs\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-oauth-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-trusted-ca-bundle\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-oauth-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.541906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.541792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-service-ca\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.565731 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.565696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:28.642722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-service-ca\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.642906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rvs\" (UniqueName: \"kubernetes.io/projected/3012b8e4-61d0-4abb-91e3-4fb62a89464d-kube-api-access-r4rvs\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.642906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.642906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.642906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-oauth-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.642906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.642886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-trusted-ca-bundle\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.643213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.643007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-oauth-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.643589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.643557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.643687 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.643562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-service-ca\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.643749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.643682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-oauth-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.643832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.643805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3012b8e4-61d0-4abb-91e3-4fb62a89464d-trusted-ca-bundle\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.645454 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.645437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-serving-cert\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.645576 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.645554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3012b8e4-61d0-4abb-91e3-4fb62a89464d-console-oauth-config\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.651582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.651522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rvs\" (UniqueName: \"kubernetes.io/projected/3012b8e4-61d0-4abb-91e3-4fb62a89464d-kube-api-access-r4rvs\") pod \"console-d564cfd4d-t459t\" (UID: \"3012b8e4-61d0-4abb-91e3-4fb62a89464d\") " pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:28.667555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.667517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:28.723374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:28.723346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:29.000252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.000222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d564cfd4d-t459t"]
Sep 15 21:18:29.002409 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:18:29.002379    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3012b8e4_61d0_4abb_91e3_4fb62a89464d.slice/crio-5d78c8da7104be8a6ec9414f66a8be50045f159a794edbf1f5fd4bb6686cc573 WatchSource:0}: Error finding container 5d78c8da7104be8a6ec9414f66a8be50045f159a794edbf1f5fd4bb6686cc573: Status 404 returned error can't find the container with id 5d78c8da7104be8a6ec9414f66a8be50045f159a794edbf1f5fd4bb6686cc573
Sep 15 21:18:29.199350 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.199311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:29.300592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.300501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:29.544377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.544334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d564cfd4d-t459t" event={"ID":"3012b8e4-61d0-4abb-91e3-4fb62a89464d","Type":"ContainerStarted","Data":"a4be879364c2fd6b69610f02c5bc84b6c0684bfdc6410493861a42fd8f3167ac"}
Sep 15 21:18:29.544855 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.544393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d564cfd4d-t459t" event={"ID":"3012b8e4-61d0-4abb-91e3-4fb62a89464d","Type":"ContainerStarted","Data":"5d78c8da7104be8a6ec9414f66a8be50045f159a794edbf1f5fd4bb6686cc573"}
Sep 15 21:18:29.546036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.546011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj" event={"ID":"4c479125-0a12-4100-bf67-4af100781ac2","Type":"ContainerStarted","Data":"c82f87a353b8c93df185b78c1e8215df183067faf0b55f44ae12e51ba90f6f31"}
Sep 15 21:18:29.564032 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.563909    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d564cfd4d-t459t" podStartSLOduration=1.563893641 podStartE2EDuration="1.563893641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:18:29.561568507 +0000 UTC m=+603.965890555" watchObservedRunningTime="2026-09-15 21:18:29.563893641 +0000 UTC m=+603.968215687"
Sep 15 21:18:29.576202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:29.576144    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6lklj" podStartSLOduration=2.945146647 podStartE2EDuration="7.576124187s" totalImagesPullingTime="4.63097754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:18:29.575720271 +0000 UTC m=+603.980042316" watchObservedRunningTime="2026-09-15 21:18:29.576124187 +0000 UTC m=+603.980446235"
Sep 15 21:18:32.524685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:32.524647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:32.651779 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:32.651742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:38.723495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:38.723441    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:38.724006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:38.723519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:38.728284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:38.728259    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:38.922269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:38.922229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:39.020319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:39.020224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:39.606868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:39.606833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d564cfd4d-t459t"
Sep 15 21:18:39.776682 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:39.776651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:39.876631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:39.876541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:39.939919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:39.939886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:41.928527 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:41.928480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:42.092452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:42.092418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:46.848860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:46.848820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:46.948708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:46.948673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:47.084143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:47.084111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:53.316979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:53.316918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:53.376541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:53.376506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:59.867002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:59.866963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:59.967329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:18:59.967294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:02.880048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:02.880006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:02.980260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:02.980225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:03.906604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:03.906570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:04.216469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:04.216369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:06.247862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.247826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:06.363317 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.363284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:06.435479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.435447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:06.770722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.770690    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:19:06.790311 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.790280    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:19:06.790474 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.790396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.792991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.792968    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 21:19:06.799630 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.799606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:19:06.876701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.876655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9dp\" (UniqueName: \"kubernetes.io/projected/739f1027-baf4-416b-974c-219808746926-kube-api-access-kr9dp\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.876917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.876710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/739f1027-baf4-416b-974c-219808746926-config-file\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.978127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.978075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9dp\" (UniqueName: \"kubernetes.io/projected/739f1027-baf4-416b-974c-219808746926-kube-api-access-kr9dp\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.978127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.978137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/739f1027-baf4-416b-974c-219808746926-config-file\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.978761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.978743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/739f1027-baf4-416b-974c-219808746926-config-file\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:06.986785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:06.986750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9dp\" (UniqueName: \"kubernetes.io/projected/739f1027-baf4-416b-974c-219808746926-kube-api-access-kr9dp\") pod \"limitador-limitador-84994f7ffc-pc669\" (UID: \"739f1027-baf4-416b-974c-219808746926\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:07.102544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.102510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:07.157000 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.156913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:07.248604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.248568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:07.382259 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.382231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:19:07.384026 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:19:07.383994    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739f1027_baf4_416b_974c_219808746926.slice/crio-8073d2e5c86b2d8a0c74117fb6358d3b5f37d584ddf8fc3a8e70997a53b5169c WatchSource:0}: Error finding container 8073d2e5c86b2d8a0c74117fb6358d3b5f37d584ddf8fc3a8e70997a53b5169c: Status 404 returned error can't find the container with id 8073d2e5c86b2d8a0c74117fb6358d3b5f37d584ddf8fc3a8e70997a53b5169c
Sep 15 21:19:07.386175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.386159    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:19:07.408246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.408212    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:07.411702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.411683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:07.414322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.414301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-smst8\""
Sep 15 21:19:07.420839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.420816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:07.428461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.428433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:07.482272 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.482230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnk9\" (UniqueName: \"kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9\") pod \"authorino-59c974bd48-g4gjr\" (UID: \"f85a1bad-8782-4415-aa2e-bf448d298f69\") " pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:07.509426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.509393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:07.583252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.583210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnk9\" (UniqueName: \"kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9\") pod \"authorino-59c974bd48-g4gjr\" (UID: \"f85a1bad-8782-4415-aa2e-bf448d298f69\") " pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:07.592799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.592747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnk9\" (UniqueName: \"kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9\") pod \"authorino-59c974bd48-g4gjr\" (UID: \"f85a1bad-8782-4415-aa2e-bf448d298f69\") " pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:07.721312 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.721210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:07.747641 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.747606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669" event={"ID":"739f1027-baf4-416b-974c-219808746926","Type":"ContainerStarted","Data":"8073d2e5c86b2d8a0c74117fb6358d3b5f37d584ddf8fc3a8e70997a53b5169c"}
Sep 15 21:19:07.991527 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:07.991503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:07.993189 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:19:07.993159    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf85a1bad_8782_4415_aa2e_bf448d298f69.slice/crio-dc5b87632bd2ea04114151e09e0604c45b5def158c895b6c8bc718c35964105a WatchSource:0}: Error finding container dc5b87632bd2ea04114151e09e0604c45b5def158c895b6c8bc718c35964105a: Status 404 returned error can't find the container with id dc5b87632bd2ea04114151e09e0604c45b5def158c895b6c8bc718c35964105a
Sep 15 21:19:08.079953 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.079900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:08.178332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.178291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:08.513369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.513328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:08.584978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.584928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:08.689218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.689177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:08.757252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.757187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-g4gjr" event={"ID":"f85a1bad-8782-4415-aa2e-bf448d298f69","Type":"ContainerStarted","Data":"dc5b87632bd2ea04114151e09e0604c45b5def158c895b6c8bc718c35964105a"}
Sep 15 21:19:08.814534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:08.814437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:11.777410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:11.777363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-g4gjr" event={"ID":"f85a1bad-8782-4415-aa2e-bf448d298f69","Type":"ContainerStarted","Data":"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"}
Sep 15 21:19:11.778923 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:11.778900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669" event={"ID":"739f1027-baf4-416b-974c-219808746926","Type":"ContainerStarted","Data":"7a3fcc718b1d2ca91d3b2fa23d1271b96f9e03c1015adf1594313b556a64990a"}
Sep 15 21:19:11.793487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:11.793444    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-g4gjr" podStartSLOduration=2.041892037 podStartE2EDuration="4.793431413s" totalImagesPullingTime="2.751539376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:19:11.792214767 +0000 UTC m=+646.196536813" watchObservedRunningTime="2026-09-15 21:19:11.793431413 +0000 UTC m=+646.197753469"
Sep 15 21:19:11.809876 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:11.809818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669" podStartSLOduration=2.449765427 podStartE2EDuration="5.809798112s" totalImagesPullingTime="3.360032685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:19:11.808718113 +0000 UTC m=+646.213040162" watchObservedRunningTime="2026-09-15 21:19:11.809798112 +0000 UTC m=+646.214120160"
Sep 15 21:19:12.784754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:12.784705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:15.139678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:15.139626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:15.235511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:15.235478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:21.687443 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:21.687409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:21.788268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:21.788219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:23.790671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:23.790643    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-pc669"
Sep 15 21:19:24.681581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:24.681536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:24.782553 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:24.782514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:27.366536 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:27.366497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:27.466294 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:27.466244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:27.841324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:27.841230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:39.745772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:39.745733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:39.898590 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:39.898555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:40.115461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.115421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:19:40.118085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.118064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.120539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.120518    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 21:19:40.128134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.128108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:19:40.175242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.175197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jsb\" (UniqueName: \"kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.175422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.175263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.276219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.276172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jsb\" (UniqueName: \"kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.276395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.276230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.278676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.278647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.283761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.283739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jsb\" (UniqueName: \"kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb\") pod \"authorino-7464566d56-l5spg\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") " pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.427594 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.427492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:19:40.698549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.698520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:19:40.700358 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:19:40.700330    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc48c8af1_ac2b_41a4_b16b_fc32081838ce.slice/crio-0076e97bd664215b7e48645d20f6640a8e52de0317d48aafb662886b8e17f24a WatchSource:0}: Error finding container 0076e97bd664215b7e48645d20f6640a8e52de0317d48aafb662886b8e17f24a: Status 404 returned error can't find the container with id 0076e97bd664215b7e48645d20f6640a8e52de0317d48aafb662886b8e17f24a
Sep 15 21:19:40.931087 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:40.931047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7464566d56-l5spg" event={"ID":"c48c8af1-ac2b-41a4-b16b-fc32081838ce","Type":"ContainerStarted","Data":"0076e97bd664215b7e48645d20f6640a8e52de0317d48aafb662886b8e17f24a"}
Sep 15 21:19:41.937342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:41.937296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7464566d56-l5spg" event={"ID":"c48c8af1-ac2b-41a4-b16b-fc32081838ce","Type":"ContainerStarted","Data":"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"}
Sep 15 21:19:41.954370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:41.954316    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7464566d56-l5spg" podStartSLOduration=1.401337808 podStartE2EDuration="1.954299415s" totalImagesPullingTime="552.961607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:19:41.952291297 +0000 UTC m=+676.356613343" watchObservedRunningTime="2026-09-15 21:19:41.954299415 +0000 UTC m=+676.358621460"
Sep 15 21:19:41.982108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:41.982069    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:41.982283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:41.982261    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-g4gjr" podUID="f85a1bad-8782-4415-aa2e-bf448d298f69" containerName="authorino" containerID="cri-o://ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617" gracePeriod=30
Sep 15 21:19:42.238403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.238376    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:42.293856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.293810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwnk9\" (UniqueName: \"kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9\") pod \"f85a1bad-8782-4415-aa2e-bf448d298f69\" (UID: \"f85a1bad-8782-4415-aa2e-bf448d298f69\") "
Sep 15 21:19:42.296183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.296156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9" (OuterVolumeSpecName: "kube-api-access-wwnk9") pod "f85a1bad-8782-4415-aa2e-bf448d298f69" (UID: "f85a1bad-8782-4415-aa2e-bf448d298f69"). InnerVolumeSpecName "kube-api-access-wwnk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:19:42.395467 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.395423    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnk9\" (UniqueName: \"kubernetes.io/projected/f85a1bad-8782-4415-aa2e-bf448d298f69-kube-api-access-wwnk9\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:19:42.944388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.944347    2560 generic.go:356] "Generic (PLEG): container finished" podID="f85a1bad-8782-4415-aa2e-bf448d298f69" containerID="ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617" exitCode=0
Sep 15 21:19:42.944388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.944395    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-g4gjr"
Sep 15 21:19:42.944991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.944441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-g4gjr" event={"ID":"f85a1bad-8782-4415-aa2e-bf448d298f69","Type":"ContainerDied","Data":"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"}
Sep 15 21:19:42.944991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.944496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-g4gjr" event={"ID":"f85a1bad-8782-4415-aa2e-bf448d298f69","Type":"ContainerDied","Data":"dc5b87632bd2ea04114151e09e0604c45b5def158c895b6c8bc718c35964105a"}
Sep 15 21:19:42.944991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.944521    2560 scope.go:117] "RemoveContainer" containerID="ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"
Sep 15 21:19:42.953764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.953743    2560 scope.go:117] "RemoveContainer" containerID="ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"
Sep 15 21:19:42.954100 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:19:42.954080    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617\": container with ID starting with ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617 not found: ID does not exist" containerID="ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"
Sep 15 21:19:42.954153 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.954110    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617"} err="failed to get container status \"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617\": rpc error: code = NotFound desc = could not find container \"ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617\": container with ID starting with ff02c516bcf8830c97ca1d420b46bc9318cd670bdb9c39cad924bdc70a2f9617 not found: ID does not exist"
Sep 15 21:19:42.965880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.965848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:42.967956 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:42.967924    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-g4gjr"]
Sep 15 21:19:44.082428 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:44.082396    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85a1bad-8782-4415-aa2e-bf448d298f69" path="/var/lib/kubelet/pods/f85a1bad-8782-4415-aa2e-bf448d298f69/volumes"
Sep 15 21:19:46.653818 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:46.653779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:46.752879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:46.752842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:46.854204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:46.854167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:49.719198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:49.719163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:49.813504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:19:49.813473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:03.022440 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:03.022404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:03.123661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:03.123623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:21.380750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:21.380656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:21.480400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:21.480365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:22.918050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:22.917991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:23.013661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:23.013601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:23.323284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:23.323196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:23.527820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:23.527754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:23.632213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:23.632166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:23.712390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:23.712336    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:24.452528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:24.452486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:20:34.524149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:34.524109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:34.619774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:34.619731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:49.266136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:49.266098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:49.730709 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:20:49.730655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:21:00.057450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:00.057403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:00.449542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:00.449500    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:21:24.284024 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:24.283991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:25.149976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:25.149927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:21:37.459739 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:37.459703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:38.947661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:38.947611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:21:49.874015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:49.873898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:51.452009 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:51.451960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:21:53.163383 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:21:53.163341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:01.738145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:01.738109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:03.570199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:03.570151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:22:05.921526 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.921485    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"]
Sep 15 21:22:05.922059 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.922039    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85a1bad-8782-4415-aa2e-bf448d298f69" containerName="authorino"
Sep 15 21:22:05.922120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.922061    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85a1bad-8782-4415-aa2e-bf448d298f69" containerName="authorino"
Sep 15 21:22:05.922185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.922174    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85a1bad-8782-4415-aa2e-bf448d298f69" containerName="authorino"
Sep 15 21:22:05.925700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.925679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.929318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.929288    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 21:22:05.929318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.929305    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2j7d9\""
Sep 15 21:22:05.929524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.929303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 15 21:22:05.929524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.929351    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 21:22:05.935736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.935709    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"]
Sep 15 21:22:05.962391 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.962355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:05.974072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.974197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.974197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.974197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.974197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9xns\" (UniqueName: \"kubernetes.io/projected/106974c6-8e8a-4a41-8c33-e8565cef837f-kube-api-access-j9xns\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:05.974378 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:05.974224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106974c6-8e8a-4a41-8c33-e8565cef837f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9xns\" (UniqueName: \"kubernetes.io/projected/106974c6-8e8a-4a41-8c33-e8565cef837f-kube-api-access-j9xns\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106974c6-8e8a-4a41-8c33-e8565cef837f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.075966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.076117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.075993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.076267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.076216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.078268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.078237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/106974c6-8e8a-4a41-8c33-e8565cef837f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.078357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.078278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106974c6-8e8a-4a41-8c33-e8565cef837f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.084792 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.084742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9xns\" (UniqueName: \"kubernetes.io/projected/106974c6-8e8a-4a41-8c33-e8565cef837f-kube-api-access-j9xns\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-skd22\" (UID: \"106974c6-8e8a-4a41-8c33-e8565cef837f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.236475 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.236384    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:06.511752 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.511724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"]
Sep 15 21:22:06.513446 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:22:06.513409    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod106974c6_8e8a_4a41_8c33_e8565cef837f.slice/crio-ce18dffb39aa1311c9bfae52e48c5fbef784249e78277f99b95133a618b66f79 WatchSource:0}: Error finding container ce18dffb39aa1311c9bfae52e48c5fbef784249e78277f99b95133a618b66f79: Status 404 returned error can't find the container with id ce18dffb39aa1311c9bfae52e48c5fbef784249e78277f99b95133a618b66f79
Sep 15 21:22:06.716155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:06.716113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22" event={"ID":"106974c6-8e8a-4a41-8c33-e8565cef837f","Type":"ContainerStarted","Data":"ce18dffb39aa1311c9bfae52e48c5fbef784249e78277f99b95133a618b66f79"}
Sep 15 21:22:07.723884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:07.723839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22" event={"ID":"106974c6-8e8a-4a41-8c33-e8565cef837f","Type":"ContainerStarted","Data":"f887e957139dd40782c5853439d12ef1c9774c523cdf8c213a801caabc63917c"}
Sep 15 21:22:07.746020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:07.745919    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22" podStartSLOduration=1.732221805 podStartE2EDuration="2.745900668s" totalImagesPullingTime="1.013678863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:22:07.74390171 +0000 UTC m=+822.148223756" watchObservedRunningTime="2026-09-15 21:22:07.745900668 +0000 UTC m=+822.150222714"
Sep 15 21:22:12.547252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:12.547209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:22:16.236925 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:16.236884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:16.237337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:16.236957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:16.249526 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:16.249495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:22:16.782925 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:22:16.782892    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-skd22"
Sep 15 21:23:20.127962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:20.127856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:26.096679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:26.096647    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:23:26.097299 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:26.096741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:23:34.013586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.013550    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5479646565-vtttt"]
Sep 15 21:23:34.016913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.016894    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.027208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.027181    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5479646565-vtttt"]
Sep 15 21:23:34.066414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.066370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f20a2845-0c22-486e-9384-6d0379e30731-tls-cert\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.066591 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.066434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfpb\" (UniqueName: \"kubernetes.io/projected/f20a2845-0c22-486e-9384-6d0379e30731-kube-api-access-ntfpb\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.167001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.166925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f20a2845-0c22-486e-9384-6d0379e30731-tls-cert\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.167182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.167017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfpb\" (UniqueName: \"kubernetes.io/projected/f20a2845-0c22-486e-9384-6d0379e30731-kube-api-access-ntfpb\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.169400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.169366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f20a2845-0c22-486e-9384-6d0379e30731-tls-cert\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.175969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.175924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfpb\" (UniqueName: \"kubernetes.io/projected/f20a2845-0c22-486e-9384-6d0379e30731-kube-api-access-ntfpb\") pod \"authorino-5479646565-vtttt\" (UID: \"f20a2845-0c22-486e-9384-6d0379e30731\") " pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.326702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.326612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479646565-vtttt"
Sep 15 21:23:34.601127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:34.601096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5479646565-vtttt"]
Sep 15 21:23:34.603032 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:23:34.603004    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf20a2845_0c22_486e_9384_6d0379e30731.slice/crio-e506fec15fe26e117d63091de5a8a1332ac3ae7397944503b38f9689531849c8 WatchSource:0}: Error finding container e506fec15fe26e117d63091de5a8a1332ac3ae7397944503b38f9689531849c8: Status 404 returned error can't find the container with id e506fec15fe26e117d63091de5a8a1332ac3ae7397944503b38f9689531849c8
Sep 15 21:23:35.188624 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:35.188590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479646565-vtttt" event={"ID":"f20a2845-0c22-486e-9384-6d0379e30731","Type":"ContainerStarted","Data":"e506fec15fe26e117d63091de5a8a1332ac3ae7397944503b38f9689531849c8"}
Sep 15 21:23:36.200947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.200887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479646565-vtttt" event={"ID":"f20a2845-0c22-486e-9384-6d0379e30731","Type":"ContainerStarted","Data":"efac79c8ebbfaa103b8d11196eb52c39cfcba1911c91e5de7cb2ed9fb3bec8fc"}
Sep 15 21:23:36.225431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.225370    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5479646565-vtttt" podStartSLOduration=2.661686323 podStartE2EDuration="3.225351731s" totalImagesPullingTime="563.665408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:23:36.222441953 +0000 UTC m=+910.626764000" watchObservedRunningTime="2026-09-15 21:23:36.225351731 +0000 UTC m=+910.629674037"
Sep 15 21:23:36.270981 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.267668    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:23:36.270981 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.267958    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7464566d56-l5spg" podUID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" containerName="authorino" containerID="cri-o://565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66" gracePeriod=30
Sep 15 21:23:36.536157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.536127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:23:36.586686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.586632    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58jsb\" (UniqueName: \"kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb\") pod \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") "
Sep 15 21:23:36.586885 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.586770    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert\") pod \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\" (UID: \"c48c8af1-ac2b-41a4-b16b-fc32081838ce\") "
Sep 15 21:23:36.588882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.588852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb" (OuterVolumeSpecName: "kube-api-access-58jsb") pod "c48c8af1-ac2b-41a4-b16b-fc32081838ce" (UID: "c48c8af1-ac2b-41a4-b16b-fc32081838ce"). InnerVolumeSpecName "kube-api-access-58jsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:23:36.599045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.599004    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c48c8af1-ac2b-41a4-b16b-fc32081838ce" (UID: "c48c8af1-ac2b-41a4-b16b-fc32081838ce"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:23:36.688089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.688051    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58jsb\" (UniqueName: \"kubernetes.io/projected/c48c8af1-ac2b-41a4-b16b-fc32081838ce-kube-api-access-58jsb\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:23:36.688089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.688084    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c48c8af1-ac2b-41a4-b16b-fc32081838ce-tls-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:23:36.837859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.837741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:36.926126 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:36.926091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:37.208475 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.208437    2560 generic.go:356] "Generic (PLEG): container finished" podID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" containerID="565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66" exitCode=0
Sep 15 21:23:37.208927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.208480    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7464566d56-l5spg"
Sep 15 21:23:37.208927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.208522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7464566d56-l5spg" event={"ID":"c48c8af1-ac2b-41a4-b16b-fc32081838ce","Type":"ContainerDied","Data":"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"}
Sep 15 21:23:37.208927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.208574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7464566d56-l5spg" event={"ID":"c48c8af1-ac2b-41a4-b16b-fc32081838ce","Type":"ContainerDied","Data":"0076e97bd664215b7e48645d20f6640a8e52de0317d48aafb662886b8e17f24a"}
Sep 15 21:23:37.208927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.208608    2560 scope.go:117] "RemoveContainer" containerID="565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"
Sep 15 21:23:37.218608 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.218584    2560 scope.go:117] "RemoveContainer" containerID="565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"
Sep 15 21:23:37.218906 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:23:37.218887    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66\": container with ID starting with 565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66 not found: ID does not exist" containerID="565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"
Sep 15 21:23:37.219020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.218914    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66"} err="failed to get container status \"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66\": rpc error: code = NotFound desc = could not find container \"565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66\": container with ID starting with 565b6c42dd66590adf9893ba2968d317a9514cd38f0f141e98ec0032b2f53b66 not found: ID does not exist"
Sep 15 21:23:37.233155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.233121    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:23:37.239806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:37.239779    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7464566d56-l5spg"]
Sep 15 21:23:38.060508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:38.060446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:38.082568 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:38.082538    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" path="/var/lib/kubelet/pods/c48c8af1-ac2b-41a4-b16b-fc32081838ce/volumes"
Sep 15 21:23:38.163103 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:38.163069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:54.850319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:54.850282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:54.947152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:54.947119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.054736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.054679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.322330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.322250    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.591458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.591356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.700480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.700437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.798432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.798401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.884356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:55.884327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.376244 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:56.376205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.468682 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:56.468638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.881198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:56.881158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.030910 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.030868    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7457-1d211d"]
Sep 15 21:23:57.031403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.031383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" containerName="authorino"
Sep 15 21:23:57.031476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.031406    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" containerName="authorino"
Sep 15 21:23:57.031533 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.031521    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48c8af1-ac2b-41a4-b16b-fc32081838ce" containerName="authorino"
Sep 15 21:23:57.034375 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.034355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:23:57.037078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.037011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mbx7k\""
Sep 15 21:23:57.039912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.039888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7457-1d211d"]
Sep 15 21:23:57.161600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.161500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5x9\" (UniqueName: \"kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9\") pod \"test-curl-7457-1d211d\" (UID: \"953fc124-8b95-4113-b1a7-db84309504ff\") " pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:23:57.262061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.262019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5x9\" (UniqueName: \"kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9\") pod \"test-curl-7457-1d211d\" (UID: \"953fc124-8b95-4113-b1a7-db84309504ff\") " pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:23:57.271049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.271024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5x9\" (UniqueName: \"kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9\") pod \"test-curl-7457-1d211d\" (UID: \"953fc124-8b95-4113-b1a7-db84309504ff\") " pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:23:57.344894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.344861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:23:57.614997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:57.614970    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7457-1d211d"]
Sep 15 21:23:57.616641 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:23:57.616613    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod953fc124_8b95_4113_b1a7_db84309504ff.slice/crio-46c25cd55565a816a6a5a8dcd29efe347bb3cadff4cfa37000883738652fa6bd WatchSource:0}: Error finding container 46c25cd55565a816a6a5a8dcd29efe347bb3cadff4cfa37000883738652fa6bd: Status 404 returned error can't find the container with id 46c25cd55565a816a6a5a8dcd29efe347bb3cadff4cfa37000883738652fa6bd
Sep 15 21:23:58.322669 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.322630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7457-1d211d" event={"ID":"953fc124-8b95-4113-b1a7-db84309504ff","Type":"ContainerStarted","Data":"46c25cd55565a816a6a5a8dcd29efe347bb3cadff4cfa37000883738652fa6bd"}
Sep 15 21:23:58.566435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.566395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:58.717248 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.717209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:58.846402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.845418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:58.894871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.894827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:23:58.952649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:23:58.952610    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.337133 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.337086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7457-1d211d" event={"ID":"953fc124-8b95-4113-b1a7-db84309504ff","Type":"ContainerStarted","Data":"d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9"}
Sep 15 21:24:00.351711 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.351662    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7457-1d211d" podStartSLOduration=1.459293848 podStartE2EDuration="3.351644745s" totalImagesPullingTime="1.892350897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:00.350824001 +0000 UTC m=+934.755146048" watchObservedRunningTime="2026-09-15 21:24:00.351644745 +0000 UTC m=+934.755966792"
Sep 15 21:24:00.429077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.429040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.523858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.523815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.769488 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.769454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.974911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:00.974884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.077069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.077036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.090984 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.090947    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:24:01.094586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.094566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.097750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.097724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-625609\""
Sep 15 21:24:01.115723 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.115695    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:24:01.184961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.184903    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7457-1d211d"]
Sep 15 21:24:01.188530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.188505    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7457-1d211d"]
Sep 15 21:24:01.199393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.199364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbxl\" (UniqueName: \"kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.199530 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.199413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.300588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.300491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbxl\" (UniqueName: \"kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.300588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.300548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.301330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.301309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.311011 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.310964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbxl\" (UniqueName: \"kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl\") pod \"payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.335509 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.335477    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7457-efec71"]
Sep 15 21:24:01.335893 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.335876    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953fc124-8b95-4113-b1a7-db84309504ff" containerName="test-curl-7457-1d211d"
Sep 15 21:24:01.335992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.335896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="953fc124-8b95-4113-b1a7-db84309504ff" containerName="test-curl-7457-1d211d"
Sep 15 21:24:01.336046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.335991    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="953fc124-8b95-4113-b1a7-db84309504ff" containerName="test-curl-7457-1d211d"
Sep 15 21:24:01.339252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.339230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:01.344521 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:01.344502    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7457-1d211d" container="test-curl-7457-1d211d"
Sep 15 21:24:01.354110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.354083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7457-efec71"]
Sep 15 21:24:01.401188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.401152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v85x\" (UniqueName: \"kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x\") pod \"test-curl-7457-efec71\" (UID: \"039740d8-81f2-4936-a8a6-d1efc4b36b5a\") " pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:01.405022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.405004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:01.502284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.502250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v85x\" (UniqueName: \"kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x\") pod \"test-curl-7457-efec71\" (UID: \"039740d8-81f2-4936-a8a6-d1efc4b36b5a\") " pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:01.510705 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.510682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v85x\" (UniqueName: \"kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x\") pod \"test-curl-7457-efec71\" (UID: \"039740d8-81f2-4936-a8a6-d1efc4b36b5a\") " pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:01.558512 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.558421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:24:01.563394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.563370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.566817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.566660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 21:24:01.566984 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.566665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vzmv2\""
Sep 15 21:24:01.567519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.567419    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-a276f9-serving-cert\""
Sep 15 21:24:01.567519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.567489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:24:01.568274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.568149    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 21:24:01.574744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.574720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:24:01.592982 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.592952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.649262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.649224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:01.660221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.660192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.677343 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.677316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:24:01.679213 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:01.679186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485bbce7_cf9c_4b32_840f_fff5b8ecbc12.slice/crio-396a0e7e17356c4f55bc4241c1830755b5fc759a1433f75ad74e9217821cfbaf WatchSource:0}: Error finding container 396a0e7e17356c4f55bc4241c1830755b5fc759a1433f75ad74e9217821cfbaf: Status 404 returned error can't find the container with id 396a0e7e17356c4f55bc4241c1830755b5fc759a1433f75ad74e9217821cfbaf
Sep 15 21:24:01.704472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.704381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.704596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.704508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.704596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.704543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjw67\" (UniqueName: \"kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.704596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.704583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.806103 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.806066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.806103 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.806116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.806329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.806136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjw67\" (UniqueName: \"kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.806329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.806165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.806329 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:01.806240    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-serving-cert: secret "maas-api-e2e-worker-w0-a276f9-serving-cert" not found
Sep 15 21:24:01.806329 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:01.806321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls podName:ebb8d28b-936d-4070-bc92-e709e6a7b9af nodeName:}" failed. No retries permitted until 2026-09-15 21:24:02.306300791 +0000 UTC m=+936.710622815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls") pod "maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" (UID: "ebb8d28b-936d-4070-bc92-e709e6a7b9af") : secret "maas-api-e2e-worker-w0-a276f9-serving-cert" not found
Sep 15 21:24:01.806975 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.806930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.808556 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.808517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.823992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.823972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjw67\" (UniqueName: \"kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:01.943960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.943912    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7457-efec71"]
Sep 15 21:24:01.945627 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:01.945597    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod039740d8_81f2_4936_a8a6_d1efc4b36b5a.slice/crio-00e66fe9ea461ee5127fddb69a0dabd17964ca91a1c496be39bd7dde84238de6 WatchSource:0}: Error finding container 00e66fe9ea461ee5127fddb69a0dabd17964ca91a1c496be39bd7dde84238de6: Status 404 returned error can't find the container with id 00e66fe9ea461ee5127fddb69a0dabd17964ca91a1c496be39bd7dde84238de6
Sep 15 21:24:01.954881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:01.954859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.310349 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.310307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:02.310575 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.310553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.312868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.312845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:02.351302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.351265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" event={"ID":"485bbce7-cf9c-4b32-840f-fff5b8ecbc12","Type":"ContainerStarted","Data":"396a0e7e17356c4f55bc4241c1830755b5fc759a1433f75ad74e9217821cfbaf"}
Sep 15 21:24:02.352928 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.352896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7457-efec71" event={"ID":"039740d8-81f2-4936-a8a6-d1efc4b36b5a","Type":"ContainerStarted","Data":"ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d"}
Sep 15 21:24:02.353084 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.352964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7457-efec71" event={"ID":"039740d8-81f2-4936-a8a6-d1efc4b36b5a","Type":"ContainerStarted","Data":"00e66fe9ea461ee5127fddb69a0dabd17964ca91a1c496be39bd7dde84238de6"}
Sep 15 21:24:02.353155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.353102    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7457-1d211d" podUID="953fc124-8b95-4113-b1a7-db84309504ff" containerName="test-curl-7457-1d211d" containerID="cri-o://d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9" gracePeriod=2
Sep 15 21:24:02.368567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.368515    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7457-efec71" podStartSLOduration=1.3684998259999999 podStartE2EDuration="1.368499826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:02.366856699 +0000 UTC m=+936.771178741" watchObservedRunningTime="2026-09-15 21:24:02.368499826 +0000 UTC m=+936.772821871"
Sep 15 21:24:02.406285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.406255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.437252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.437216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:24:02.441211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.441182    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.443806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.443753    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a276f9\""
Sep 15 21:24:02.443806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.443784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a276f9-dockercfg-78wzk\""
Sep 15 21:24:02.458898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.458870    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:24:02.477998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.477930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:02.512615 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.512581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.512799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.512779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqw5m\" (UniqueName: \"kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.613648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.613610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.613846 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.613722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqw5m\" (UniqueName: \"kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.614525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.614501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.623187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.623164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqw5m\" (UniqueName: \"kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m\") pod \"payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.754280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.754249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:02.769481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.769450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:24:02.840202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.840168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.951670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:02.951571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.049947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.049905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7457-efec71"]
Sep 15 21:24:03.055597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.055565    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7457-efec71"]
Sep 15 21:24:03.095653 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:03.095610    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb8d28b_936d_4070_bc92_e709e6a7b9af.slice/crio-b99956cd8c17f955faad7aab0d4ec232b0172893c35a737bdfe1d0927a39efd6 WatchSource:0}: Error finding container b99956cd8c17f955faad7aab0d4ec232b0172893c35a737bdfe1d0927a39efd6: Status 404 returned error can't find the container with id b99956cd8c17f955faad7aab0d4ec232b0172893c35a737bdfe1d0927a39efd6
Sep 15 21:24:03.359631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.359586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" event={"ID":"ebb8d28b-936d-4070-bc92-e709e6a7b9af","Type":"ContainerStarted","Data":"b99956cd8c17f955faad7aab0d4ec232b0172893c35a737bdfe1d0927a39efd6"}
Sep 15 21:24:03.361444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.361410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" event={"ID":"485bbce7-cf9c-4b32-840f-fff5b8ecbc12","Type":"ContainerStarted","Data":"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"}
Sep 15 21:24:03.361581 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:03.361565    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7457-efec71" container="test-curl-7457-efec71"
Sep 15 21:24:03.376190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.376108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:24:03.378983 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:03.378949    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6f2d69_7fec_4f39_9480_1afcfcbf575a.slice/crio-06993bba9db1deab212c060b64bfe63854486370725bf315cda2cb2d728ea584 WatchSource:0}: Error finding container 06993bba9db1deab212c060b64bfe63854486370725bf315cda2cb2d728ea584: Status 404 returned error can't find the container with id 06993bba9db1deab212c060b64bfe63854486370725bf315cda2cb2d728ea584
Sep 15 21:24:03.391724 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.391673    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" podStartSLOduration=0.924468297 podStartE2EDuration="2.39162133s" totalImagesPullingTime="1.467153033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:03.388414086 +0000 UTC m=+937.792736133" watchObservedRunningTime="2026-09-15 21:24:03.39162133 +0000 UTC m=+937.795943377"
Sep 15 21:24:03.400520 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.400497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.502618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.502530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.599690 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.599658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.674083 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.674049    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:24:03.674443 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.674431    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" containerName="test-curl-7457-efec71"
Sep 15 21:24:03.674487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.674445    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" containerName="test-curl-7457-efec71"
Sep 15 21:24:03.674523 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.674518    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" containerName="test-curl-7457-efec71"
Sep 15 21:24:03.677819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.677796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.680453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.680427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-70880c-dockercfg-qjd9z\""
Sep 15 21:24:03.680672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.680634    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-70880c\""
Sep 15 21:24:03.693012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.692980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:24:03.705869 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.705839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.826506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.826416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxh2k\" (UniqueName: \"kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.826506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.826486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.927971 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.927671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxh2k\" (UniqueName: \"kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.927971 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.927743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.943951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.929312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.943951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.942076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxh2k\" (UniqueName: \"kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k\") pod \"payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:03.943951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.942201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.988453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:03.988414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:04.042959 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.041598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.275731 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.275694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.284885 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.284261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:24:04.287349 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:04.286777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3e7e76_bbb8_4645_a3c6_3310864bd70f.slice/crio-4e51f0dd53dd280048617397eb7bdc6a2c9c8f4ddbe04cbc8600bcf364fc2f30 WatchSource:0}: Error finding container 4e51f0dd53dd280048617397eb7bdc6a2c9c8f4ddbe04cbc8600bcf364fc2f30: Status 404 returned error can't find the container with id 4e51f0dd53dd280048617397eb7bdc6a2c9c8f4ddbe04cbc8600bcf364fc2f30
Sep 15 21:24:04.375687 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.375654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" event={"ID":"6a6f2d69-7fec-4f39-9480-1afcfcbf575a","Type":"ContainerStarted","Data":"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"}
Sep 15 21:24:04.376003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.375718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" event={"ID":"6a6f2d69-7fec-4f39-9480-1afcfcbf575a","Type":"ContainerStarted","Data":"06993bba9db1deab212c060b64bfe63854486370725bf315cda2cb2d728ea584"}
Sep 15 21:24:04.376136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.376117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:04.380064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.379917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" event={"ID":"3f3e7e76-bbb8-4645-a3c6-3310864bd70f","Type":"ContainerStarted","Data":"4e51f0dd53dd280048617397eb7bdc6a2c9c8f4ddbe04cbc8600bcf364fc2f30"}
Sep 15 21:24:04.380184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.380057    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7457-efec71" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" containerName="test-curl-7457-efec71" containerID="cri-o://ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d" gracePeriod=2
Sep 15 21:24:04.380659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.380438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:04.395475 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.395401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" podStartSLOduration=2.39538278 podStartE2EDuration="2.39538278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:04.393118893 +0000 UTC m=+938.797440941" watchObservedRunningTime="2026-09-15 21:24:04.39538278 +0000 UTC m=+938.799704870"
Sep 15 21:24:04.590897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.590863    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:24:04.695203 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.695167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.735599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.735556    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r5x9\" (UniqueName: \"kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9\") pod \"953fc124-8b95-4113-b1a7-db84309504ff\" (UID: \"953fc124-8b95-4113-b1a7-db84309504ff\") "
Sep 15 21:24:04.738683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.738641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9" (OuterVolumeSpecName: "kube-api-access-7r5x9") pod "953fc124-8b95-4113-b1a7-db84309504ff" (UID: "953fc124-8b95-4113-b1a7-db84309504ff"). InnerVolumeSpecName "kube-api-access-7r5x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:24:04.806245 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.806205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.837517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.837431    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r5x9\" (UniqueName: \"kubernetes.io/projected/953fc124-8b95-4113-b1a7-db84309504ff-kube-api-access-7r5x9\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:04.910389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:04.910277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.006281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.006207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.277497 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.277458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.389076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.389039    2560 generic.go:356] "Generic (PLEG): container finished" podID="953fc124-8b95-4113-b1a7-db84309504ff" containerID="d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9" exitCode=137
Sep 15 21:24:05.389488 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.389190    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:24:05.389554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.389515    2560 scope.go:117] "RemoveContainer" containerID="d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9"
Sep 15 21:24:05.391450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.391363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" event={"ID":"3f3e7e76-bbb8-4645-a3c6-3310864bd70f","Type":"ContainerStarted","Data":"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"}
Sep 15 21:24:05.391856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.391618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:05.440676 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:05.440611    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7457-1d211d\" is forbidden: User \"system:node:ip-10-0-137-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-138.ec2.internal' and this object" podUID="953fc124-8b95-4113-b1a7-db84309504ff" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:24:05.441697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.441641    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" podStartSLOduration=2.441620312 podStartE2EDuration="2.441620312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:05.437493201 +0000 UTC m=+939.841815249" watchObservedRunningTime="2026-09-15 21:24:05.441620312 +0000 UTC m=+939.845942362"
Sep 15 21:24:05.838800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.838758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.903229 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.903198    2560 scope.go:117] "RemoveContainer" containerID="d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9"
Sep 15 21:24:05.903615 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:05.903592    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9\": container with ID starting with d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9 not found: ID does not exist" containerID="d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9"
Sep 15 21:24:05.903702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.903627    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9"} err="failed to get container status \"d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9\": rpc error: code = NotFound desc = could not find container \"d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9\": container with ID starting with d7531a291043d8d9d07645e80d9d521d5125b5f69267de759a217636f1ebd4a9 not found: ID does not exist"
Sep 15 21:24:05.966151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:05.966125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:06.086166 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:06.086128    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7457-1d211d\" is forbidden: User \"system:node:ip-10-0-137-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-138.ec2.internal' and this object" podUID="953fc124-8b95-4113-b1a7-db84309504ff" pod="opendatahub/test-curl-7457-1d211d"
Sep 15 21:24:06.088717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.088692    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953fc124-8b95-4113-b1a7-db84309504ff" path="/var/lib/kubelet/pods/953fc124-8b95-4113-b1a7-db84309504ff/volumes"
Sep 15 21:24:06.399252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.399223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" event={"ID":"ebb8d28b-936d-4070-bc92-e709e6a7b9af","Type":"ContainerStarted","Data":"5c7b2884fef6e4a13804465166c7641e647e828af9bae6df7536e910ea74e51b"}
Sep 15 21:24:06.417638 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.417578    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" podStartSLOduration=2.561739286 podStartE2EDuration="5.417561418s" totalImagesPullingTime="2.855822132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:06.416039221 +0000 UTC m=+940.820361267" watchObservedRunningTime="2026-09-15 21:24:06.417561418 +0000 UTC m=+940.821883456"
Sep 15 21:24:06.568085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.568061    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:06.654231 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.654124    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v85x\" (UniqueName: \"kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x\") pod \"039740d8-81f2-4936-a8a6-d1efc4b36b5a\" (UID: \"039740d8-81f2-4936-a8a6-d1efc4b36b5a\") "
Sep 15 21:24:06.656189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.656154    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x" (OuterVolumeSpecName: "kube-api-access-9v85x") pod "039740d8-81f2-4936-a8a6-d1efc4b36b5a" (UID: "039740d8-81f2-4936-a8a6-d1efc4b36b5a"). InnerVolumeSpecName "kube-api-access-9v85x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:24:06.755042 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.755002    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v85x\" (UniqueName: \"kubernetes.io/projected/039740d8-81f2-4936-a8a6-d1efc4b36b5a-kube-api-access-9v85x\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:06.808006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:06.807965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:07.406417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.406380    2560 generic.go:356] "Generic (PLEG): container finished" podID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" containerID="ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d" exitCode=137
Sep 15 21:24:07.406858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.406434    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:07.406858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.406471    2560 scope.go:117] "RemoveContainer" containerID="ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d"
Sep 15 21:24:07.406858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.406724    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:07.415587 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.415567    2560 scope.go:117] "RemoveContainer" containerID="ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d"
Sep 15 21:24:07.415890 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:07.415870    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d\": container with ID starting with ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d not found: ID does not exist" containerID="ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d"
Sep 15 21:24:07.415997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.415898    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d"} err="failed to get container status \"ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d\": rpc error: code = NotFound desc = could not find container \"ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d\": container with ID starting with ff88470fa2d5de5db400f7bfe1d07502276bda34061dbd319958715bf367cf7d not found: ID does not exist"
Sep 15 21:24:07.416928 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:07.416896    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7457-efec71\" is forbidden: User \"system:node:ip-10-0-137-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-138.ec2.internal' and this object" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" pod="opendatahub/test-curl-7457-efec71"
Sep 15 21:24:07.611330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.611295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:07.719976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:07.719883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:08.083618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:08.083541    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="039740d8-81f2-4936-a8a6-d1efc4b36b5a" path="/var/lib/kubelet/pods/039740d8-81f2-4936-a8a6-d1efc4b36b5a/volumes"
Sep 15 21:24:08.238525 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:08.238493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:08.348924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:08.348894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:09.577431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:09.577398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.423324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:10.423285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.465584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.465550    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:11.471464 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.471439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.474033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.474008    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-44fbc30a-serving-cert\""
Sep 15 21:24:11.485132 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.485106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:11.500673 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.500639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.595249 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.595196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.600499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.600471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.600653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.600516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.600653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.600598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts6bj\" (UniqueName: \"kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.600653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.600622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.698134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.698095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.701130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.701101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts6bj\" (UniqueName: \"kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.701273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.701135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.701273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.701199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.701273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.701232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.702207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.702179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.704132 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.704106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.704227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.704157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.712664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.712642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts6bj\" (UniqueName: \"kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj\") pod \"maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:11.782911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:11.782831    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:12.069104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.069012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:12.083777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.083754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:12.084857 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:12.084831    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3caa95bf_c0b2_4ee3_a43b_a5d1b84da757.slice/crio-660aafc9fa0b3672e0c813c6236fb877b015d2760d8598fde66e80b86c9b6966 WatchSource:0}: Error finding container 660aafc9fa0b3672e0c813c6236fb877b015d2760d8598fde66e80b86c9b6966: Status 404 returned error can't find the container with id 660aafc9fa0b3672e0c813c6236fb877b015d2760d8598fde66e80b86c9b6966
Sep 15 21:24:12.086476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.086457    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:24:12.212006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.211973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:12.437765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.437723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" event={"ID":"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757","Type":"ContainerStarted","Data":"660aafc9fa0b3672e0c813c6236fb877b015d2760d8598fde66e80b86c9b6966"}
Sep 15 21:24:12.602023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.601976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:12.703908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.703860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:12.903335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:12.903296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.233470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.233433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.331401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.331369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.404621 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.404587    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:24:13.408252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.408235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.411433 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.411409    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-faa4c5\""
Sep 15 21:24:13.418615 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.418595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:24:13.429347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.429321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:24:13.444180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.444139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" event={"ID":"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757","Type":"ContainerStarted","Data":"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"}
Sep 15 21:24:13.444318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.444206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:13.518742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.518645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.519220 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.519000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92bdc\" (UniqueName: \"kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.555672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.555620    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" podStartSLOduration=1.953881511 podStartE2EDuration="2.555600345s" totalImagesPullingTime="601.718834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:13.551480619 +0000 UTC m=+947.955802667" watchObservedRunningTime="2026-09-15 21:24:13.555600345 +0000 UTC m=+947.959922391"
Sep 15 21:24:13.620579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.620542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.620579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.620584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92bdc\" (UniqueName: \"kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.621393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.621373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.639773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.639741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92bdc\" (UniqueName: \"kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc\") pod \"payload-processing-e2e-autores-faa4c5-795785477c-9k6kw\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") " pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.682352 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.682302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.718804 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.718772    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:13.994728 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:13.994687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:24:13.996887 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:13.996856    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0f40ac_f4c9_40e6_8be5_89f8717993ee.slice/crio-877fa795d6e110860b0fcd85c8e7de4c47835bc2b37ef368d49fa5c6bf3f22c1 WatchSource:0}: Error finding container 877fa795d6e110860b0fcd85c8e7de4c47835bc2b37ef368d49fa5c6bf3f22c1: Status 404 returned error can't find the container with id 877fa795d6e110860b0fcd85c8e7de4c47835bc2b37ef368d49fa5c6bf3f22c1
Sep 15 21:24:14.009440 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.009411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.119558 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.119525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.216548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.216507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.302916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.302831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.407531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.407497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.451526 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.451479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" event={"ID":"0e0f40ac-f4c9-40e6-8be5-89f8717993ee","Type":"ContainerStarted","Data":"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"}
Sep 15 21:24:14.451703 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.451540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" event={"ID":"0e0f40ac-f4c9-40e6-8be5-89f8717993ee","Type":"ContainerStarted","Data":"877fa795d6e110860b0fcd85c8e7de4c47835bc2b37ef368d49fa5c6bf3f22c1"}
Sep 15 21:24:14.451703 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.451669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:14.475374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:14.475321    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" podStartSLOduration=1.475304824 podStartE2EDuration="1.475304824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:14.472549291 +0000 UTC m=+948.876871337" watchObservedRunningTime="2026-09-15 21:24:14.475304824 +0000 UTC m=+948.879626869"
Sep 15 21:24:15.088520 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:15.088481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.394144 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:15.394113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:24:15.394374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:15.394354    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:24:16.197429 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:16.197388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:16.401664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:16.401635    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:24:17.170318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:17.170277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:17.296644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:17.296609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:18.111926 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:18.111893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:24:18.237862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:18.237824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:18.478208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:18.478086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:18.575461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:18.575415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:18.933193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:18.933157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.084255 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:19.084216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.284817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:19.284710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.457449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:19.457415    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:19.583584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:19.583489    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.795086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:19.795051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:20.878470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:20.878436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:21.831477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:21.831433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:22.724140 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:22.724080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:23.557469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:23.557431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:23.692851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:23.692815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:23.911811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:23.911779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:24.262489 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:24.262406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:24.532461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:24.532368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:24.662078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:24.662046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:25.459320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:25.459288    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:24:25.713729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:25.713660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:26.496668 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:26.496581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:27.361138 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:27.361099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:27.494510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:27.494475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:27.944536 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:27.944496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:28.087268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:28.087234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:28.708656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:28.708624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:29.800243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:29.800210    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:30.895424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:30.895389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:31.702721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:31.702683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:32.795079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:32.795030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:32.928883 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:32.928849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.029701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.029663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.318217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.318181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.474640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.474596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.540403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.540366    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:24:33.545604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.545586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.549143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.549123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-779ace-dockercfg-7rpw7\""
Sep 15 21:24:33.549822 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.549803    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-779ace\""
Sep 15 21:24:33.565343 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.565313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:24:33.594179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.594100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkt8d\" (UniqueName: \"kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.594179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.594169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.612880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.612848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.695394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.695356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkt8d\" (UniqueName: \"kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.695555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.695431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.696180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.696155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.703894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.703874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkt8d\" (UniqueName: \"kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d\") pod \"payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.856072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.856044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:33.916201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:33.916156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:34.132252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.132218    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:24:34.133431 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:34.133405    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c39d710_b545_4c10_8fdb_c441b35d426b.slice/crio-023e300d3a28aabbf1304f4336c75221d2a59a42113e353520b897339b290485 WatchSource:0}: Error finding container 023e300d3a28aabbf1304f4336c75221d2a59a42113e353520b897339b290485: Status 404 returned error can't find the container with id 023e300d3a28aabbf1304f4336c75221d2a59a42113e353520b897339b290485
Sep 15 21:24:34.566748 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.566653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" event={"ID":"9c39d710-b545-4c10-8fdb-c441b35d426b","Type":"ContainerStarted","Data":"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"}
Sep 15 21:24:34.566748 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.566711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" event={"ID":"9c39d710-b545-4c10-8fdb-c441b35d426b","Type":"ContainerStarted","Data":"023e300d3a28aabbf1304f4336c75221d2a59a42113e353520b897339b290485"}
Sep 15 21:24:34.567001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.566795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:34.589277 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.589222    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" podStartSLOduration=1.589205199 podStartE2EDuration="1.589205199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:34.587906464 +0000 UTC m=+968.992228503" watchObservedRunningTime="2026-09-15 21:24:34.589205199 +0000 UTC m=+968.993527246"
Sep 15 21:24:34.903914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:34.903870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.280162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:35.280074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.416995 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:35.416961    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.514569 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:35.514533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.810441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:35.810406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.635227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:36.635187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:37.858076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:37.858041    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.675953 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.675901    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:38.676453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.676417    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" podUID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" containerName="maas-api" containerID="cri-o://c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b" gracePeriod=30
Sep 15 21:24:38.713973 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.713923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.817132 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.817093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.922666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.922631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.925177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.925159    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:38.946742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.946665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca\") pod \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") "
Sep 15 21:24:38.946742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.946725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts6bj\" (UniqueName: \"kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj\") pod \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") "
Sep 15 21:24:38.946906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.946765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls\") pod \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") "
Sep 15 21:24:38.946906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.946844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs\") pod \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\" (UID: \"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757\") "
Sep 15 21:24:38.947095 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.947064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" (UID: "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:24:38.947203 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.947183    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-openshift-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:38.949121 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.949083    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" (UID: "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:24:38.949291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.949264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj" (OuterVolumeSpecName: "kube-api-access-ts6bj") pod "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" (UID: "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757"). InnerVolumeSpecName "kube-api-access-ts6bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:24:38.949422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.949394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" (UID: "3caa95bf-c0b2-4ee3-a43b-a5d1b84da757"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:24:38.991367 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:38.991323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:24:39.027493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.027450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.048141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.048105    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-metrics-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:39.048141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.048139    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts6bj\" (UniqueName: \"kubernetes.io/projected/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-kube-api-access-ts6bj\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:39.048395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.048155    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757-maas-api-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:24:39.126327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.126291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.327827 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.327734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.596270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.596188    2560 generic.go:356] "Generic (PLEG): container finished" podID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" containerID="c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b" exitCode=0
Sep 15 21:24:39.596270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.596231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" event={"ID":"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757","Type":"ContainerDied","Data":"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"}
Sep 15 21:24:39.596493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.596276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m" event={"ID":"3caa95bf-c0b2-4ee3-a43b-a5d1b84da757","Type":"ContainerDied","Data":"660aafc9fa0b3672e0c813c6236fb877b015d2760d8598fde66e80b86c9b6966"}
Sep 15 21:24:39.596493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.596296    2560 scope.go:117] "RemoveContainer" containerID="c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"
Sep 15 21:24:39.596493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.596238    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"
Sep 15 21:24:39.606024 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.605985    2560 scope.go:117] "RemoveContainer" containerID="c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"
Sep 15 21:24:39.606297 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:24:39.606267    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b\": container with ID starting with c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b not found: ID does not exist" containerID="c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"
Sep 15 21:24:39.606367 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.606302    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b"} err="failed to get container status \"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b\": rpc error: code = NotFound desc = could not find container \"c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b\": container with ID starting with c194fc396b38051c80c61db2daa7ed6ea51528b9defe72c737e86b7cd7d2633b not found: ID does not exist"
Sep 15 21:24:39.623572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.623546    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:39.629415 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.629389    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-44fbc30a-7f766d476f-c2q8m"]
Sep 15 21:24:39.630956 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.630922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.763839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.763801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.877093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.877062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.978511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:39.978472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.082229 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.082198    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" path="/var/lib/kubelet/pods/3caa95bf-c0b2-4ee3-a43b-a5d1b84da757/volumes"
Sep 15 21:24:40.311268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.311181    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:24:40.311672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.311653    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" containerName="maas-api"
Sep 15 21:24:40.311754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.311674    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" containerName="maas-api"
Sep 15 21:24:40.311813 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.311783    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3caa95bf-c0b2-4ee3-a43b-a5d1b84da757" containerName="maas-api"
Sep 15 21:24:40.314814 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.314791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.318164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.318143    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 21:24:40.318618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.318604    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b2f6c94e-gw-openshift-default-dockercfg-f7ds2\""
Sep 15 21:24:40.337046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.337019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:24:40.359313 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359624 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359624 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqsh\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.359766 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.359700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.375402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.375371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.461029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.460986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqsh\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461776 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461849 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.461954 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.461922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.464016 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.463990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.464190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.464172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.476301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.476272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.482280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.482260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqsh\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh\") pod \"e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") " pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.622260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.622222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.625749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.625727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:40.783036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.783003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.926898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:40.926874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:24:40.928663 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:40.928638    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a2ac2d_8910_48a3_a5de_10a559bd150c.slice/crio-fb57460dfc739363ff7598d9cd3259423f5258b5e3a6f492665a8adf52966f02 WatchSource:0}: Error finding container fb57460dfc739363ff7598d9cd3259423f5258b5e3a6f492665a8adf52966f02: Status 404 returned error can't find the container with id fb57460dfc739363ff7598d9cd3259423f5258b5e3a6f492665a8adf52966f02
Sep 15 21:24:41.612353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:41.612309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerStarted","Data":"fb57460dfc739363ff7598d9cd3259423f5258b5e3a6f492665a8adf52966f02"}
Sep 15 21:24:41.787974 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:41.787916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:42.568348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:42.568305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:42.775136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:42.775085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.073401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.073324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.180002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.179957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.280988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.280895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.373501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.373460    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:43.373607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.373564    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:43.373607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.373596    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:43.626677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.626579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerStarted","Data":"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"}
Sep 15 21:24:43.648359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.648309    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podStartSLOduration=1.205984424 podStartE2EDuration="3.648293235s" totalImagesPullingTime="2.442308811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:43.646115177 +0000 UTC m=+978.050437223" watchObservedRunningTime="2026-09-15 21:24:43.648293235 +0000 UTC m=+978.052615280"
Sep 15 21:24:43.856888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:43.856856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:44.626609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:44.626574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:44.632542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:44.632514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:44.777527 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:44.777494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:45.186545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.186510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:45.280258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.280223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:45.575337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.575257    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:24:45.638075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.638046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:45.638986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.638959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:24:45.863129 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:45.863096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.671406 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:46.671375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:47.602885 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:47.602851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:47.709619 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:47.709580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:48.606211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:48.606169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:49.443771 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:49.443737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:49.520035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:49.519992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:49.960988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:49.960950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:50.058851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.058818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:50.089123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.089087    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:24:50.092586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.092569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.096169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.096147    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b2f6c94e\""
Sep 15 21:24:50.105205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.105178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:24:50.156610 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.156576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.156828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.156643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-529vx\" (UniqueName: \"kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.173803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.173767    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:24:50.177421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.177404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.180587 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.180564    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b2f6c94e-dockercfg-gm6fw\""
Sep 15 21:24:50.190199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.190176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:24:50.258003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.257909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpz99\" (UniqueName: \"kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.258003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.257972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.258185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.258090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.258185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.258123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-529vx\" (UniqueName: \"kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.258696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.258671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.267679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.267650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-529vx\" (UniqueName: \"kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx\") pod \"payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") " pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.359330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.359295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpz99\" (UniqueName: \"kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.359512 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.359357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.359994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.359976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.368306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.368283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpz99\" (UniqueName: \"kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99\") pod \"payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.381314 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.381262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:50.403916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.403890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:50.483511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.483474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:50.488345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.488320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:50.583158 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.583120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:50.683416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.683389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:24:50.684617 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:50.684589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ac6412_0c6f_47e5_aabb_c62e728e6db8.slice/crio-59183ecd379ea5efc59854ee9868a726a7810d576729e87d6aee19656b01c473 WatchSource:0}: Error finding container 59183ecd379ea5efc59854ee9868a726a7810d576729e87d6aee19656b01c473: Status 404 returned error can't find the container with id 59183ecd379ea5efc59854ee9868a726a7810d576729e87d6aee19656b01c473
Sep 15 21:24:50.764554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:50.764512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:24:50.764827 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:24:50.764801    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8286e749_1b3f_42ae_8593_ac5c66bcba19.slice/crio-d639bd39607ce1acbd3f4f2b31ce90a79bcbec36c915e23bf3ec56dbbf7f9252 WatchSource:0}: Error finding container d639bd39607ce1acbd3f4f2b31ce90a79bcbec36c915e23bf3ec56dbbf7f9252: Status 404 returned error can't find the container with id d639bd39607ce1acbd3f4f2b31ce90a79bcbec36c915e23bf3ec56dbbf7f9252
Sep 15 21:24:51.651251 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.651205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:51.681087 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.681051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" event={"ID":"8286e749-1b3f-42ae-8593-ac5c66bcba19","Type":"ContainerStarted","Data":"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"}
Sep 15 21:24:51.681283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.681109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" event={"ID":"8286e749-1b3f-42ae-8593-ac5c66bcba19","Type":"ContainerStarted","Data":"d639bd39607ce1acbd3f4f2b31ce90a79bcbec36c915e23bf3ec56dbbf7f9252"}
Sep 15 21:24:51.681283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.681137    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:24:51.683190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.683164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" event={"ID":"85ac6412-0c6f-47e5-aabb-c62e728e6db8","Type":"ContainerStarted","Data":"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"}
Sep 15 21:24:51.683318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.683203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" event={"ID":"85ac6412-0c6f-47e5-aabb-c62e728e6db8","Type":"ContainerStarted","Data":"59183ecd379ea5efc59854ee9868a726a7810d576729e87d6aee19656b01c473"}
Sep 15 21:24:51.683318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.683252    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:24:51.737323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.737255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" podStartSLOduration=1.73723429 podStartE2EDuration="1.73723429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:51.735442132 +0000 UTC m=+986.139764176" watchObservedRunningTime="2026-09-15 21:24:51.73723429 +0000 UTC m=+986.141556339"
Sep 15 21:24:51.778140 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:51.778087    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" podStartSLOduration=1.778071465 podStartE2EDuration="1.778071465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:51.776442204 +0000 UTC m=+986.180764250" watchObservedRunningTime="2026-09-15 21:24:51.778071465 +0000 UTC m=+986.182393511"
Sep 15 21:24:53.085805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:53.085768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:53.143629 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:53.143598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:53.898157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:53.898113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:55.755770 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:24:55.755735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:25:02.531091 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.531051    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:25:02.535104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.535081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.539036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.539000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a276f9\"/\"default-dockercfg-ksdmf\""
Sep 15 21:25:02.539165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.539037    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a276f9\"/\"kube-root-ca.crt\""
Sep 15 21:25:02.539165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.539000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a276f9\"/\"simulator-w0-a276f9-kserve-self-signed-certs\""
Sep 15 21:25:02.539311 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.539289    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a276f9\"/\"openshift-service-ca.crt\""
Sep 15 21:25:02.548039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.548011    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:25:02.673664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.673857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prcdb\" (UniqueName: \"kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.673857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.673857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.674086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.674086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.673984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.691102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.691078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:25:02.691217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.691146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:25:02.775333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.775482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prcdb\" (UniqueName: \"kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.775551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.775614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.775676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.775726 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.775699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.776145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.776101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.776285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.776168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.776285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.776235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.778180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.778151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.778325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.778269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.786761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.786728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prcdb\" (UniqueName: \"kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb\") pod \"simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") " pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:02.819854 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.819816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:02.845862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:02.845822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:03.122040 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:03.121987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:25:03.125581 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:03.125548    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd83f470b_1e74_4657_96b8_1b1cc1f679a2.slice/crio-dcbad63d3d675b65e7959c9e6ea672a4f1848ce2f3d0561270d382b874a05dff WatchSource:0}: Error finding container dcbad63d3d675b65e7959c9e6ea672a4f1848ce2f3d0561270d382b874a05dff: Status 404 returned error can't find the container with id dcbad63d3d675b65e7959c9e6ea672a4f1848ce2f3d0561270d382b874a05dff
Sep 15 21:25:03.764303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:03.764260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" event={"ID":"d83f470b-1e74-4657-96b8-1b1cc1f679a2","Type":"ContainerStarted","Data":"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"}
Sep 15 21:25:03.764733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:03.764319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" event={"ID":"d83f470b-1e74-4657-96b8-1b1cc1f679a2","Type":"ContainerStarted","Data":"dcbad63d3d675b65e7959c9e6ea672a4f1848ce2f3d0561270d382b874a05dff"}
Sep 15 21:25:03.783669 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:03.783618    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" podStartSLOduration=1.783599881 podStartE2EDuration="1.783599881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:03.78144589 +0000 UTC m=+998.185767966" watchObservedRunningTime="2026-09-15 21:25:03.783599881 +0000 UTC m=+998.187921955"
Sep 15 21:25:05.777467 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.777436    2560 generic.go:356] "Generic (PLEG): container finished" podID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerID="b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a" exitCode=0
Sep 15 21:25:05.777907 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.777509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerDied","Data":"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"}
Sep 15 21:25:05.778016 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.777987    2560 scope.go:117] "RemoveContainer" containerID="b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"
Sep 15 21:25:05.779133 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.779102    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:05.779213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.779171    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:05.779213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:05.779202    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:06.786755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:06.786715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerStarted","Data":"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"}
Sep 15 21:25:07.626227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:07.626186    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:07.626442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:07.626418    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:25:07.626506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:07.626468    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 21:25:08.627068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:08.627025    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:25:08.627554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:08.627126    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 21:25:09.626768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:09.626721    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:25:09.626998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:09.626792    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 21:25:10.453917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:10.453875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:25:10.522778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:10.522741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:10.626353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:10.626315    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:25:10.626552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:10.626384    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 21:25:11.626284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:11.626247    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:25:11.626749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:11.626309    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 21:25:12.012945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.012848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.630793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.630758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:12.631279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.631172    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:12.631757 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.631738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:12.846388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.846352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:12.846555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.846411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:12.858695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.858668    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:12.900726 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:12.900622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:13.699356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:13.699323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:13.846954 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:13.846910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:25:14.475756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:14.475722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:15.180892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.180855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:15.232891 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.232854    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"]
Sep 15 21:25:15.238739 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.238717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:15.242472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.242257    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:25:15.245631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.245604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"]
Sep 15 21:25:15.311818 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.311781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9\" (UID: \"3b7ead13-b178-41f2-b9e2-a32e3fef8880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:15.413386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.413344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9\" (UID: \"3b7ead13-b178-41f2-b9e2-a32e3fef8880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:15.414048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.414028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9\" (UID: \"3b7ead13-b178-41f2-b9e2-a32e3fef8880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:15.551797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.551708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:15.826654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.826627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"]
Sep 15 21:25:15.828133 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:15.828107    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7ead13_b178_41f2_b9e2_a32e3fef8880.slice/crio-6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9 WatchSource:0}: Error finding container 6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9: Status 404 returned error can't find the container with id 6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9
Sep 15 21:25:15.848327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.848295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9" event={"ID":"3b7ead13-b178-41f2-b9e2-a32e3fef8880","Type":"ContainerStarted","Data":"6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9"}
Sep 15 21:25:15.947041 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:15.947004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:16.647829 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:16.647791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:17.489459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:17.489426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.079146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:18.079118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.392359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:18.392325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.871844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:18.871753    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b7ead13-b178-41f2-b9e2-a32e3fef8880" containerID="88e85accc0aae2392913b3d212f06ff35c68e8246ebb894dc34a78771ffa3ade" exitCode=0
Sep 15 21:25:18.872043 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:18.871845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9" event={"ID":"3b7ead13-b178-41f2-b9e2-a32e3fef8880","Type":"ContainerDied","Data":"88e85accc0aae2392913b3d212f06ff35c68e8246ebb894dc34a78771ffa3ade"}
Sep 15 21:25:19.140745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:19.140651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:19.992371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:19.992328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:20.024612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.024583    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:20.062729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.062692    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca\") pod \"3b7ead13-b178-41f2-b9e2-a32e3fef8880\" (UID: \"3b7ead13-b178-41f2-b9e2-a32e3fef8880\") "
Sep 15 21:25:20.063199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.063169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b7ead13-b178-41f2-b9e2-a32e3fef8880" (UID: "3b7ead13-b178-41f2-b9e2-a32e3fef8880"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:20.163663 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.163567    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7ead13-b178-41f2-b9e2-a32e3fef8880-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:20.679160 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.679122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:20.886900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.886866    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"
Sep 15 21:25:20.887115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.886901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9" event={"ID":"3b7ead13-b178-41f2-b9e2-a32e3fef8880","Type":"ContainerDied","Data":"6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9"}
Sep 15 21:25:20.887115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:20.886969    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ee8582b3422e03b3327bdfaee50a56b912cc93982eb41def1c25630d9ff75b9"
Sep 15 21:25:26.317729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.317686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:26.900464 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.900425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:26.931761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.931725    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:25:26.932018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.931987    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" podUID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" containerName="payload-processing" containerID="cri-o://47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85" gracePeriod=30
Sep 15 21:25:26.940722 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.940467    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:25:26.941141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.941110    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" podUID="8286e749-1b3f-42ae-8593-ac5c66bcba19" containerName="payload-pre-processing" containerID="cri-o://baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5" gracePeriod=30
Sep 15 21:25:26.976651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:26.976619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.038903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.038871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.124827 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.124796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.125711 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.125696    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"]
Sep 15 21:25:27.129689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.129665    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2f6c94e-mbtb9"]
Sep 15 21:25:27.196637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.196541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.226538 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.226484    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:25:27.229751 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.229720    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:25:27.262373 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.262340    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:25:27.262638 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.262612    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" containerID="cri-o://9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c" gracePeriod=30
Sep 15 21:25:27.271507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.271445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.338150 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338117    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpz99\" (UniqueName: \"kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99\") pod \"8286e749-1b3f-42ae-8593-ac5c66bcba19\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") "
Sep 15 21:25:27.338150 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume\") pod \"8286e749-1b3f-42ae-8593-ac5c66bcba19\" (UID: \"8286e749-1b3f-42ae-8593-ac5c66bcba19\") "
Sep 15 21:25:27.338645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume\") pod \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") "
Sep 15 21:25:27.338645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338433    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-529vx\" (UniqueName: \"kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx\") pod \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\" (UID: \"85ac6412-0c6f-47e5-aabb-c62e728e6db8\") "
Sep 15 21:25:27.338736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8286e749-1b3f-42ae-8593-ac5c66bcba19" (UID: "8286e749-1b3f-42ae-8593-ac5c66bcba19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:27.338736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85ac6412-0c6f-47e5-aabb-c62e728e6db8" (UID: "85ac6412-0c6f-47e5-aabb-c62e728e6db8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:27.338828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.338772    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8286e749-1b3f-42ae-8593-ac5c66bcba19-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:27.340659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.340629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx" (OuterVolumeSpecName: "kube-api-access-529vx") pod "85ac6412-0c6f-47e5-aabb-c62e728e6db8" (UID: "85ac6412-0c6f-47e5-aabb-c62e728e6db8"). InnerVolumeSpecName "kube-api-access-529vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:27.340794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.340741    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99" (OuterVolumeSpecName: "kube-api-access-kpz99") pod "8286e749-1b3f-42ae-8593-ac5c66bcba19" (UID: "8286e749-1b3f-42ae-8593-ac5c66bcba19"). InnerVolumeSpecName "kube-api-access-kpz99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:27.440073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.440019    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85ac6412-0c6f-47e5-aabb-c62e728e6db8-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:27.440073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.440066    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-529vx\" (UniqueName: \"kubernetes.io/projected/85ac6412-0c6f-47e5-aabb-c62e728e6db8-kube-api-access-529vx\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:27.440073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.440076    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpz99\" (UniqueName: \"kubernetes.io/projected/8286e749-1b3f-42ae-8593-ac5c66bcba19-kube-api-access-kpz99\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:27.588368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.588274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.633494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.633455    2560 patch_prober.go:28] interesting pod/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 15 21:25:27.633688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.633527    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 21:25:27.718599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.718560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:27.927425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.927392    2560 generic.go:356] "Generic (PLEG): container finished" podID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" containerID="47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85" exitCode=0
Sep 15 21:25:27.927631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.927444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"
Sep 15 21:25:27.927631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.927482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" event={"ID":"85ac6412-0c6f-47e5-aabb-c62e728e6db8","Type":"ContainerDied","Data":"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"}
Sep 15 21:25:27.927631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.927533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f" event={"ID":"85ac6412-0c6f-47e5-aabb-c62e728e6db8","Type":"ContainerDied","Data":"59183ecd379ea5efc59854ee9868a726a7810d576729e87d6aee19656b01c473"}
Sep 15 21:25:27.927631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.927556    2560 scope.go:117] "RemoveContainer" containerID="47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"
Sep 15 21:25:27.928917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.928894    2560 generic.go:356] "Generic (PLEG): container finished" podID="8286e749-1b3f-42ae-8593-ac5c66bcba19" containerID="baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5" exitCode=0
Sep 15 21:25:27.929055 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.928928    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"
Sep 15 21:25:27.929055 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.928965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" event={"ID":"8286e749-1b3f-42ae-8593-ac5c66bcba19","Type":"ContainerDied","Data":"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"}
Sep 15 21:25:27.929055 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.929009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2" event={"ID":"8286e749-1b3f-42ae-8593-ac5c66bcba19","Type":"ContainerDied","Data":"d639bd39607ce1acbd3f4f2b31ce90a79bcbec36c915e23bf3ec56dbbf7f9252"}
Sep 15 21:25:27.939768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.939747    2560 scope.go:117] "RemoveContainer" containerID="47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"
Sep 15 21:25:27.940368 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:25:27.940111    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85\": container with ID starting with 47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85 not found: ID does not exist" containerID="47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"
Sep 15 21:25:27.940368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.940140    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85"} err="failed to get container status \"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85\": rpc error: code = NotFound desc = could not find container \"47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85\": container with ID starting with 47c8f192408f483d88e943727e2996e466220a5facf0262440d75468b224aa85 not found: ID does not exist"
Sep 15 21:25:27.940368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.940158    2560 scope.go:117] "RemoveContainer" containerID="baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"
Sep 15 21:25:27.949143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.949118    2560 scope.go:117] "RemoveContainer" containerID="baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"
Sep 15 21:25:27.949472 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:25:27.949454    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5\": container with ID starting with baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5 not found: ID does not exist" containerID="baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"
Sep 15 21:25:27.949548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.949479    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5"} err="failed to get container status \"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5\": rpc error: code = NotFound desc = could not find container \"baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5\": container with ID starting with baa2f57aa68ea779b6a977062217fd4ba53d20833acf7b9533654309551ff2b5 not found: ID does not exist"
Sep 15 21:25:27.958628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.958597    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:25:27.970750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.970715    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b2f6c94e-cc9d9f946-fz52f"]
Sep 15 21:25:27.987273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:27.987242    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:25:28.003986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.003954    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:25:28.004580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" containerName="payload-processing"
Sep 15 21:25:28.004642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004585    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" containerName="payload-processing"
Sep 15 21:25:28.004642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004614    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7ead13-b178-41f2-b9e2-a32e3fef8880" containerName="revoke-keys"
Sep 15 21:25:28.004642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004624    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7ead13-b178-41f2-b9e2-a32e3fef8880" containerName="revoke-keys"
Sep 15 21:25:28.004642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004637    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8286e749-1b3f-42ae-8593-ac5c66bcba19" containerName="payload-pre-processing"
Sep 15 21:25:28.004810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004646    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8286e749-1b3f-42ae-8593-ac5c66bcba19" containerName="payload-pre-processing"
Sep 15 21:25:28.004810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004751    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7ead13-b178-41f2-b9e2-a32e3fef8880" containerName="revoke-keys"
Sep 15 21:25:28.004810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004783    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8286e749-1b3f-42ae-8593-ac5c66bcba19" containerName="payload-pre-processing"
Sep 15 21:25:28.004810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.004796    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" containerName="payload-processing"
Sep 15 21:25:28.008231 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.008211    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b2f6c94e-7cd76fc88b-vggr2"]
Sep 15 21:25:28.008314 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.008304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.011072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.011051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d219b8ad-openshift-default-dockercfg-l5kw6\""
Sep 15 21:25:28.022639 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.022616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:25:28.082745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.082650    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7ead13-b178-41f2-b9e2-a32e3fef8880" path="/var/lib/kubelet/pods/3b7ead13-b178-41f2-b9e2-a32e3fef8880/volumes"
Sep 15 21:25:28.083177 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.083156    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8286e749-1b3f-42ae-8593-ac5c66bcba19" path="/var/lib/kubelet/pods/8286e749-1b3f-42ae-8593-ac5c66bcba19/volumes"
Sep 15 21:25:28.083589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.083575    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ac6412-0c6f-47e5-aabb-c62e728e6db8" path="/var/lib/kubelet/pods/85ac6412-0c6f-47e5-aabb-c62e728e6db8/volumes"
Sep 15 21:25:28.146329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbsg\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.146718 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.146623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.205462 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.205375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:28.247665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.247841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.247841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.247841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbsg\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.247894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248375 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248513 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.248577 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.248556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.250463 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.250437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.250620 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.250600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.256974 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.256921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.257061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.256926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbsg\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg\") pod \"e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") " pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.298737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.298704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:28.319703 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.319666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:28.601895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.601865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:25:28.603343 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:28.603317    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8110123_a75c_40fa_85cf_d825ddbe6848.slice/crio-89025da317b7c56e93977491a68ef5952f77bc1f794a506c47f429d3c615f6af WatchSource:0}: Error finding container 89025da317b7c56e93977491a68ef5952f77bc1f794a506c47f429d3c615f6af: Status 404 returned error can't find the container with id 89025da317b7c56e93977491a68ef5952f77bc1f794a506c47f429d3c615f6af
Sep 15 21:25:28.605693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.605660    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:28.605787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.605731    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:28.605787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.605762    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:28.609311 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.609285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:28.941715 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.941608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerStarted","Data":"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"}
Sep 15 21:25:28.941715 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.941682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerStarted","Data":"89025da317b7c56e93977491a68ef5952f77bc1f794a506c47f429d3c615f6af"}
Sep 15 21:25:28.966005 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:28.965926    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podStartSLOduration=1.9659097939999999 podStartE2EDuration="1.965909794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:28.963265029 +0000 UTC m=+1023.367587091" watchObservedRunningTime="2026-09-15 21:25:28.965909794 +0000 UTC m=+1023.370231841"
Sep 15 21:25:29.321027 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:29.320927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:29.326416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:29.326386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:29.445797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:29.445760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:29.948418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:29.948383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:29.949473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:29.949455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:30.227532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:30.227493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:30.336480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:30.336441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:30.424880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:30.424845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:31.298143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:31.298109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:32.144645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.144610    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:32.517523 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.517493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:32.593660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.593845 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.593845 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.593845 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593753    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.593845 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593790    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.593845 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmqsh\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593965    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token\") pod \"72a2ac2d-8910-48a3-a5de-10a559bd150c\" (UID: \"72a2ac2d-8910-48a3-a5de-10a559bd150c\") "
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.593959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data" (OuterVolumeSpecName: "istio-data") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:32.594146 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:32.594420 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:32.594420 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594309    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:32.594420 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594399    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.594567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594428    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.594567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594442    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.594567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594456    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.594567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.594468    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72a2ac2d-8910-48a3-a5de-10a559bd150c-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.596110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.596080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh" (OuterVolumeSpecName: "kube-api-access-gmqsh") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "kube-api-access-gmqsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:32.596110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.596092    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token" (OuterVolumeSpecName: "istio-token") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:32.596260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.596140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:25:32.596260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.596149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72a2ac2d-8910-48a3-a5de-10a559bd150c" (UID: "72a2ac2d-8910-48a3-a5de-10a559bd150c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:32.695257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.695167    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.695257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.695199    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.695257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.695210    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmqsh\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-kube-api-access-gmqsh\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.695257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.695222    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72a2ac2d-8910-48a3-a5de-10a559bd150c-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:32.916894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.916857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:32.966903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.966811    2560 generic.go:356] "Generic (PLEG): container finished" podID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerID="9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c" exitCode=0
Sep 15 21:25:32.966903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.966875    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"
Sep 15 21:25:32.967197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.966914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerDied","Data":"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"}
Sep 15 21:25:32.967197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.966988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh" event={"ID":"72a2ac2d-8910-48a3-a5de-10a559bd150c","Type":"ContainerDied","Data":"fb57460dfc739363ff7598d9cd3259423f5258b5e3a6f492665a8adf52966f02"}
Sep 15 21:25:32.967197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.967011    2560 scope.go:117] "RemoveContainer" containerID="9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"
Sep 15 21:25:32.977192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.977162    2560 scope.go:117] "RemoveContainer" containerID="b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"
Sep 15 21:25:32.983484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.983461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:32.987414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.987399    2560 scope.go:117] "RemoveContainer" containerID="9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"
Sep 15 21:25:32.987675 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:25:32.987658    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c\": container with ID starting with 9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c not found: ID does not exist" containerID="9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"
Sep 15 21:25:32.987721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.987684    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c"} err="failed to get container status \"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c\": rpc error: code = NotFound desc = could not find container \"9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c\": container with ID starting with 9ce6c58e71968eb34f0ed409ec9aaf748ac3d7180a3f06bf0e37b530ee88d93c not found: ID does not exist"
Sep 15 21:25:32.987721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.987699    2560 scope.go:117] "RemoveContainer" containerID="b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"
Sep 15 21:25:32.987958 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:25:32.987925    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a\": container with ID starting with b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a not found: ID does not exist" containerID="b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"
Sep 15 21:25:32.988012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.987955    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a"} err="failed to get container status \"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a\": rpc error: code = NotFound desc = could not find container \"b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a\": container with ID starting with b9e9902784c966528b8d909550790d7e375c099ebd994e1d19ff6ab77aac548a not found: ID does not exist"
Sep 15 21:25:32.992629 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.992606    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:25:32.996473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:32.996447    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b2f6c94e-gw-openshift-default-5d67b7fd9b-jbnsh"]
Sep 15 21:25:33.214683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.214646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:33.267117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.267030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:25:33.448996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.448966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:33.549608 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.549522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:33.563725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.563684    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:25:33.564323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.564299    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.564429 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.564327    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.564473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.564446    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.564473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.564456    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.567740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.567724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.570185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.570165    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d219b8ad\""
Sep 15 21:25:33.570289 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.570206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d219b8ad-dockercfg-v2f58\""
Sep 15 21:25:33.578894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.578865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:25:33.636844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.636807    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:25:33.637241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.637228    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.637292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.637242    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" containerName="istio-proxy"
Sep 15 21:25:33.639407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.639392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.650311 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.650283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:25:33.706687 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.706655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.706853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.706702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frnbr\" (UniqueName: \"kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.808265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.808166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.808265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.808255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.808479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.808298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frnbr\" (UniqueName: \"kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.808479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.808363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tff7\" (UniqueName: \"kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.808996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.808975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.816896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.816872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frnbr\" (UniqueName: \"kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr\") pod \"payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") " pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.878164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.878126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:33.909282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.909249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.909451 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.909359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tff7\" (UniqueName: \"kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.909965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.909926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.918011 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.917966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tff7\" (UniqueName: \"kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7\") pod \"payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:33.951853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:33.951814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:34.011723 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.010237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:34.083109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.083027    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a2ac2d-8910-48a3-a5de-10a559bd150c" path="/var/lib/kubelet/pods/72a2ac2d-8910-48a3-a5de-10a559bd150c/volumes"
Sep 15 21:25:34.149292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.149266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:25:34.150756 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:34.150725    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bcd1d4_7e25_41b8_b17e_99b8de916714.slice/crio-fb119724fe5fbf8ae952eda303e2db0697dea66db1b907d05a537a5162ff9d02 WatchSource:0}: Error finding container fb119724fe5fbf8ae952eda303e2db0697dea66db1b907d05a537a5162ff9d02: Status 404 returned error can't find the container with id fb119724fe5fbf8ae952eda303e2db0697dea66db1b907d05a537a5162ff9d02
Sep 15 21:25:34.226234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.226208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:25:34.228348 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:34.228309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c9ec6d_c9dd_4f65_9e71_6eb25e669ded.slice/crio-9cff41afad41597f14942e1ca98bd5208b422b12d89def65686bd173f821f5e8 WatchSource:0}: Error finding container 9cff41afad41597f14942e1ca98bd5208b422b12d89def65686bd173f821f5e8: Status 404 returned error can't find the container with id 9cff41afad41597f14942e1ca98bd5208b422b12d89def65686bd173f821f5e8
Sep 15 21:25:34.930054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.930015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:34.983367 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.983326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" event={"ID":"33bcd1d4-7e25-41b8-b17e-99b8de916714","Type":"ContainerStarted","Data":"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"}
Sep 15 21:25:34.983549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.983418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" event={"ID":"33bcd1d4-7e25-41b8-b17e-99b8de916714","Type":"ContainerStarted","Data":"fb119724fe5fbf8ae952eda303e2db0697dea66db1b907d05a537a5162ff9d02"}
Sep 15 21:25:34.983549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.983472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:34.984973 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.984948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" event={"ID":"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded","Type":"ContainerStarted","Data":"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"}
Sep 15 21:25:34.985088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.984996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" event={"ID":"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded","Type":"ContainerStarted","Data":"9cff41afad41597f14942e1ca98bd5208b422b12d89def65686bd173f821f5e8"}
Sep 15 21:25:34.985088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:34.985025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:35.007757 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:35.007712    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" podStartSLOduration=2.007698435 podStartE2EDuration="2.007698435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:35.00555399 +0000 UTC m=+1029.409876037" watchObservedRunningTime="2026-09-15 21:25:35.007698435 +0000 UTC m=+1029.412020480"
Sep 15 21:25:35.024924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:35.024870    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" podStartSLOduration=2.024852613 podStartE2EDuration="2.024852613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:35.023533093 +0000 UTC m=+1029.427855141" watchObservedRunningTime="2026-09-15 21:25:35.024852613 +0000 UTC m=+1029.429174662"
Sep 15 21:25:35.748603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:35.748568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:36.445348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:36.445316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:37.416255 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:37.416223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:45.177763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:45.177725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:45.993325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:45.993291    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:25:45.993499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:45.993361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:25:50.852371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:50.852332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:25:53.865107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:53.865072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:54.097337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.097303    2560 generic.go:356] "Generic (PLEG): container finished" podID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerID="953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7" exitCode=0
Sep 15 21:25:54.097512 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.097369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerDied","Data":"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"}
Sep 15 21:25:54.097750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.097736    2560 scope.go:117] "RemoveContainer" containerID="953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"
Sep 15 21:25:54.098811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.098787    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:54.098900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.098885    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:54.098954 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:54.098920    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:55.108572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:55.108524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerStarted","Data":"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"}
Sep 15 21:25:55.319999 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:55.319958    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:25:55.321327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:55.321298    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:25:55.321556 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:55.321520    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:25:55.389759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:55.389683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:56.083020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.082988    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"]
Sep 15 21:25:56.085966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.085947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:56.089050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.089029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:25:56.093794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.093355    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"]
Sep 15 21:25:56.114959 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.108402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:56.131644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.131596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh\" (UID: \"fdea30d3-ffde-4295-80e1-278fcaea36e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:56.232662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.232622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh\" (UID: \"fdea30d3-ffde-4295-80e1-278fcaea36e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:56.233359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.233333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh\" (UID: \"fdea30d3-ffde-4295-80e1-278fcaea36e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:56.320960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.320293    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:25:56.320960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.320358    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:25:56.398325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.398288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:56.690670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:56.690639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"]
Sep 15 21:25:56.691813 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:25:56.691783    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdea30d3_ffde_4295_80e1_278fcaea36e8.slice/crio-70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e WatchSource:0}: Error finding container 70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e: Status 404 returned error can't find the container with id 70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e
Sep 15 21:25:57.052495 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.052411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.133347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.133311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh" event={"ID":"fdea30d3-ffde-4295-80e1-278fcaea36e8","Type":"ContainerStarted","Data":"56ca4fd6bde7de22889567ebee7ff7c65d7715e0a7db3c413efcbddebb184dce"}
Sep 15 21:25:57.133683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.133375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh" event={"ID":"fdea30d3-ffde-4295-80e1-278fcaea36e8","Type":"ContainerStarted","Data":"70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e"}
Sep 15 21:25:57.153517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.153470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh" podStartSLOduration=1.153453979 podStartE2EDuration="1.153453979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:57.152000342 +0000 UTC m=+1051.556322388" watchObservedRunningTime="2026-09-15 21:25:57.153453979 +0000 UTC m=+1051.557776025"
Sep 15 21:25:57.320991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.320866    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:25:57.320991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.320956    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:25:57.779983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:57.779928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:58.141063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:58.141026    2560 generic.go:356] "Generic (PLEG): container finished" podID="fdea30d3-ffde-4295-80e1-278fcaea36e8" containerID="56ca4fd6bde7de22889567ebee7ff7c65d7715e0a7db3c413efcbddebb184dce" exitCode=0
Sep 15 21:25:58.141474 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:58.141080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh" event={"ID":"fdea30d3-ffde-4295-80e1-278fcaea36e8","Type":"ContainerDied","Data":"56ca4fd6bde7de22889567ebee7ff7c65d7715e0a7db3c413efcbddebb184dce"}
Sep 15 21:25:58.320777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:58.320288    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:25:58.320777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:58.320364    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:25:58.501927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:58.501828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:59.291432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.291402    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:25:59.320735 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.320293    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:25:59.320735 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.320354    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:25:59.360422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.360388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca\") pod \"fdea30d3-ffde-4295-80e1-278fcaea36e8\" (UID: \"fdea30d3-ffde-4295-80e1-278fcaea36e8\") "
Sep 15 21:25:59.360733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.360709    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fdea30d3-ffde-4295-80e1-278fcaea36e8" (UID: "fdea30d3-ffde-4295-80e1-278fcaea36e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:59.380944 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.380897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:59.461539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.461451    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdea30d3-ffde-4295-80e1-278fcaea36e8-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:25:59.949329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:25:59.949283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:26:00.079481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.079450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:00.155284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.155250    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"
Sep 15 21:26:00.155453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.155283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh" event={"ID":"fdea30d3-ffde-4295-80e1-278fcaea36e8","Type":"ContainerDied","Data":"70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e"}
Sep 15 21:26:00.155453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.155326    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70538e846a49cae190debaff4711ef5383100600ea2896264dce2da274343b6e"
Sep 15 21:26:00.320961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.320842    2560 patch_prober.go:28] interesting pod/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 15 21:26:00.320961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.320902    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 15 21:26:00.781246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:00.781212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:01.324447 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:01.324415    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:26:01.325551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:01.325532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:26:01.697772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:01.697736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:02.359381 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.359343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:02.386072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.386038    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:26:02.386323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.386296    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" podUID="33bcd1d4-7e25-41b8-b17e-99b8de916714" containerName="payload-processing" containerID="cri-o://b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1" gracePeriod=30
Sep 15 21:26:02.395072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.395044    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:26:02.395260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.395239    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" podUID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" containerName="payload-pre-processing" containerID="cri-o://369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c" gracePeriod=30
Sep 15 21:26:02.495274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.495237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:02.595508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.595471    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"]
Sep 15 21:26:02.601574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.601544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:02.606312 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.606281    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d219b8ad-6c4vh"]
Sep 15 21:26:02.646878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.646854    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:26:02.667094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.667064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:02.671032 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.671009    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:26:02.697251 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.697218    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume\") pod \"33bcd1d4-7e25-41b8-b17e-99b8de916714\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") "
Sep 15 21:26:02.697416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.697265    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frnbr\" (UniqueName: \"kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr\") pod \"33bcd1d4-7e25-41b8-b17e-99b8de916714\" (UID: \"33bcd1d4-7e25-41b8-b17e-99b8de916714\") "
Sep 15 21:26:02.697640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.697613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33bcd1d4-7e25-41b8-b17e-99b8de916714" (UID: "33bcd1d4-7e25-41b8-b17e-99b8de916714"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:02.699407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.699384    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr" (OuterVolumeSpecName: "kube-api-access-frnbr") pod "33bcd1d4-7e25-41b8-b17e-99b8de916714" (UID: "33bcd1d4-7e25-41b8-b17e-99b8de916714"). InnerVolumeSpecName "kube-api-access-frnbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:02.798672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.798633    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume\") pod \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") "
Sep 15 21:26:02.798863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.798679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tff7\" (UniqueName: \"kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7\") pod \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\" (UID: \"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded\") "
Sep 15 21:26:02.799023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.799003    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bcd1d4-7e25-41b8-b17e-99b8de916714-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:02.799089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.799029    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frnbr\" (UniqueName: \"kubernetes.io/projected/33bcd1d4-7e25-41b8-b17e-99b8de916714-kube-api-access-frnbr\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:02.799156 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.799107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" (UID: "91c9ec6d-c9dd-4f65-9e71-6eb25e669ded"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:02.800765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.800742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7" (OuterVolumeSpecName: "kube-api-access-5tff7") pod "91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" (UID: "91c9ec6d-c9dd-4f65-9e71-6eb25e669ded"). InnerVolumeSpecName "kube-api-access-5tff7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:02.899965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.899857    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:02.899965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:02.899886    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tff7\" (UniqueName: \"kubernetes.io/projected/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded-kube-api-access-5tff7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:03.104368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.104326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:03.174147 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.174053    2560 generic.go:356] "Generic (PLEG): container finished" podID="33bcd1d4-7e25-41b8-b17e-99b8de916714" containerID="b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1" exitCode=0
Sep 15 21:26:03.174147 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.174099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"
Sep 15 21:26:03.174364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.174139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" event={"ID":"33bcd1d4-7e25-41b8-b17e-99b8de916714","Type":"ContainerDied","Data":"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"}
Sep 15 21:26:03.174364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.174196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9" event={"ID":"33bcd1d4-7e25-41b8-b17e-99b8de916714","Type":"ContainerDied","Data":"fb119724fe5fbf8ae952eda303e2db0697dea66db1b907d05a537a5162ff9d02"}
Sep 15 21:26:03.174364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.174229    2560 scope.go:117] "RemoveContainer" containerID="b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"
Sep 15 21:26:03.175586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.175567    2560 generic.go:356] "Generic (PLEG): container finished" podID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" containerID="369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c" exitCode=0
Sep 15 21:26:03.175679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.175599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" event={"ID":"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded","Type":"ContainerDied","Data":"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"}
Sep 15 21:26:03.175679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.175653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw" event={"ID":"91c9ec6d-c9dd-4f65-9e71-6eb25e669ded","Type":"ContainerDied","Data":"9cff41afad41597f14942e1ca98bd5208b422b12d89def65686bd173f821f5e8"}
Sep 15 21:26:03.175679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.175611    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"
Sep 15 21:26:03.183639 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.183618    2560 scope.go:117] "RemoveContainer" containerID="b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"
Sep 15 21:26:03.183918 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:03.183899    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1\": container with ID starting with b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1 not found: ID does not exist" containerID="b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"
Sep 15 21:26:03.184008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.183924    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1"} err="failed to get container status \"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1\": rpc error: code = NotFound desc = could not find container \"b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1\": container with ID starting with b83972aa7de02a88c9187f8561ad95edf764c54f565f0575f86aafb7305d82b1 not found: ID does not exist"
Sep 15 21:26:03.184008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.183965    2560 scope.go:117] "RemoveContainer" containerID="369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"
Sep 15 21:26:03.192369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.192351    2560 scope.go:117] "RemoveContainer" containerID="369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"
Sep 15 21:26:03.192628 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:03.192610    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c\": container with ID starting with 369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c not found: ID does not exist" containerID="369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"
Sep 15 21:26:03.192680 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.192637    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c"} err="failed to get container status \"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c\": rpc error: code = NotFound desc = could not find container \"369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c\": container with ID starting with 369e736dbf60bc695f69e436ee2be59a64ff9d7a0b7f0f157ff4ffb05c68438c not found: ID does not exist"
Sep 15 21:26:03.201209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.201185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:26:03.209235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.209211    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d219b8ad-876d649f8-nvtcw"]
Sep 15 21:26:03.218581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.218557    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:26:03.226873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.226848    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d219b8ad-785cbff5fc-nzfq9"]
Sep 15 21:26:03.745987 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.745931    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:26:03.746542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.746145    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy" containerID="cri-o://fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49" gracePeriod=30
Sep 15 21:26:03.798900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.798858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:03.898985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:03.898929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:04.081968 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.081845    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33bcd1d4-7e25-41b8-b17e-99b8de916714" path="/var/lib/kubelet/pods/33bcd1d4-7e25-41b8-b17e-99b8de916714/volumes"
Sep 15 21:26:04.082350 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.082331    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" path="/var/lib/kubelet/pods/91c9ec6d-c9dd-4f65-9e71-6eb25e669ded/volumes"
Sep 15 21:26:04.082681 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.082665    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdea30d3-ffde-4295-80e1-278fcaea36e8" path="/var/lib/kubelet/pods/fdea30d3-ffde-4295-80e1-278fcaea36e8/volumes"
Sep 15 21:26:04.255979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.255883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:04.488076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488044    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:04.488597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488573    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33bcd1d4-7e25-41b8-b17e-99b8de916714" containerName="payload-processing"
Sep 15 21:26:04.488597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488595    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33bcd1d4-7e25-41b8-b17e-99b8de916714" containerName="payload-processing"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488606    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" containerName="payload-pre-processing"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488612    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" containerName="payload-pre-processing"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488623    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdea30d3-ffde-4295-80e1-278fcaea36e8" containerName="revoke-keys"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488629    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdea30d3-ffde-4295-80e1-278fcaea36e8" containerName="revoke-keys"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488712    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33bcd1d4-7e25-41b8-b17e-99b8de916714" containerName="payload-processing"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488726    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdea30d3-ffde-4295-80e1-278fcaea36e8" containerName="revoke-keys"
Sep 15 21:26:04.488796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.488733    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c9ec6d-c9dd-4f65-9e71-6eb25e669ded" containerName="payload-pre-processing"
Sep 15 21:26:04.491981 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.491963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.494552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.494534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-639cece9-openshift-default-dockercfg-57tvz\""
Sep 15 21:26:04.505905 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.505858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:04.515992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.515928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:04.614730 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.614901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.614901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.614901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.614901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.614901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfqg5\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.615085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.614991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.615085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.615022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.615085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.615041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.715833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.715993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfqg5\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716419 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.716537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.716455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.718280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.718261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.718445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.718430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.722080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.722054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:04.732573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.732548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.732875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.732860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfqg5\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5\") pod \"e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") " pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:04.801877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:04.801793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:05.028045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.028010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:05.082631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.082601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:05.083748 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:05.083718    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31d95e1_85d1_41e3_bd33_9b4849f05c69.slice/crio-fca3f2aa999a0bdb5e8bd8adc304d4651b7b69f841fcd8757e3162796cc8d758 WatchSource:0}: Error finding container fca3f2aa999a0bdb5e8bd8adc304d4651b7b69f841fcd8757e3162796cc8d758: Status 404 returned error can't find the container with id fca3f2aa999a0bdb5e8bd8adc304d4651b7b69f841fcd8757e3162796cc8d758
Sep 15 21:26:05.085969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.085920    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:05.086076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.086024    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:05.086076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.086069    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:05.193227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.193190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerStarted","Data":"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"}
Sep 15 21:26:05.193417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.193254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerStarted","Data":"fca3f2aa999a0bdb5e8bd8adc304d4651b7b69f841fcd8757e3162796cc8d758"}
Sep 15 21:26:05.221038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.220976    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podStartSLOduration=1.220954554 podStartE2EDuration="1.220954554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:05.219482951 +0000 UTC m=+1059.623804997" watchObservedRunningTime="2026-09-15 21:26:05.220954554 +0000 UTC m=+1059.625276597"
Sep 15 21:26:05.770434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.770394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:05.802379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:05.802353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:06.665088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:06.665051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:06.763745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:06.763706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:06.807095 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:06.807061    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:06.880566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:06.880524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:07.205070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:07.205039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:07.205996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:07.205963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:07.902142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:07.902081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:08.996087 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:08.996058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:08.999478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:08.999458    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:26:09.057224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057384    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057502    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtbsg\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057570    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data\") pod \"c8110123-a75c-40fa-85cf-d825ddbe6848\" (UID: \"c8110123-a75c-40fa-85cf-d825ddbe6848\") "
Sep 15 21:26:09.057602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057568    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.057884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.058098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.058123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.058179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.058190    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8110123-a75c-40fa-85cf-d825ddbe6848-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.058232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.058211    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.059743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.059718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:09.060024 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.059993    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:09.060120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.060054    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg" (OuterVolumeSpecName: "kube-api-access-mtbsg") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "kube-api-access-mtbsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:09.060368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.060328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8110123-a75c-40fa-85cf-d825ddbe6848" (UID: "c8110123-a75c-40fa-85cf-d825ddbe6848"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:26:09.097717 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.097686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:09.158810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158775    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.158810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158803    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.158810 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158814    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtbsg\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-kube-api-access-mtbsg\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.159088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158825    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.159088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158834    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.159088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158841    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.159088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.158849    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8110123-a75c-40fa-85cf-d825ddbe6848-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:09.198489 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.198459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:09.217677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.217648    2560 generic.go:356] "Generic (PLEG): container finished" podID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerID="fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49" exitCode=0
Sep 15 21:26:09.217800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.217693    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"
Sep 15 21:26:09.217800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.217739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerDied","Data":"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"}
Sep 15 21:26:09.217800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.217789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj" event={"ID":"c8110123-a75c-40fa-85cf-d825ddbe6848","Type":"ContainerDied","Data":"89025da317b7c56e93977491a68ef5952f77bc1f794a506c47f429d3c615f6af"}
Sep 15 21:26:09.217906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.217814    2560 scope.go:117] "RemoveContainer" containerID="fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"
Sep 15 21:26:09.230479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.230455    2560 scope.go:117] "RemoveContainer" containerID="953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"
Sep 15 21:26:09.239111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.239092    2560 scope.go:117] "RemoveContainer" containerID="fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"
Sep 15 21:26:09.239416 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:09.239376    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49\": container with ID starting with fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49 not found: ID does not exist" containerID="fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"
Sep 15 21:26:09.239416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.239405    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49"} err="failed to get container status \"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49\": rpc error: code = NotFound desc = could not find container \"fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49\": container with ID starting with fc79c8533cf6756dd6d4e200efa5fdde2ad3df205748c84e265751f548e33c49 not found: ID does not exist"
Sep 15 21:26:09.239544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.239422    2560 scope.go:117] "RemoveContainer" containerID="953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"
Sep 15 21:26:09.239698 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:09.239666    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7\": container with ID starting with 953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7 not found: ID does not exist" containerID="953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"
Sep 15 21:26:09.239790 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.239695    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7"} err="failed to get container status \"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7\": rpc error: code = NotFound desc = could not find container \"953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7\": container with ID starting with 953447793d4cd8bd00f0fb963fbc64309ab688c1c3cd56c3397a6730cebbd8d7 not found: ID does not exist"
Sep 15 21:26:09.243212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.243188    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:26:09.248117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.248096    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d219b8ad-openshift-default-665b689854-q8mbj"]
Sep 15 21:26:09.493655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.493622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:09.590075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.590040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:09.625704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.625670    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:09.626137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.626123    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.626198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.626139    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.626198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.626150    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.626198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.626155    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.626304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.626261    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.629393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.629376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.632395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.632372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-639cece9\""
Sep 15 21:26:09.632816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.632795    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-639cece9-dockercfg-2q5dd\""
Sep 15 21:26:09.647042 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.647018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:09.730265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.730230    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:09.731684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.731657    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" containerName="istio-proxy"
Sep 15 21:26:09.733778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.733759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.752866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.752800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:09.765371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.765341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65t2\" (UniqueName: \"kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.765508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.765382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.866376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.866337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65t2\" (UniqueName: \"kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.866376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.866380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.866592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.866402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.866626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.866579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq584\" (UniqueName: \"kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.867126 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.867108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.879563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.879537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65t2\" (UniqueName: \"kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2\") pod \"payload-processing-e2e-derive-639cece9-54977d7db9-mk24t\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") " pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.914678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.914641    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:26:09.917481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.917461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.928870 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.928849    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-faa4c5\"/\"autores-model-faa4c5-kserve-self-signed-certs\""
Sep 15 21:26:09.929168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.929152    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-faa4c5\"/\"default-dockercfg-zmlxn\""
Sep 15 21:26:09.929320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.929303    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-faa4c5\"/\"openshift-service-ca.crt\""
Sep 15 21:26:09.929664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.929652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-faa4c5\"/\"kube-root-ca.crt\""
Sep 15 21:26:09.937265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.937237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:26:09.940037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.940016    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:09.967371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq584\" (UniqueName: \"kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.967537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.967537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fh9\" (UniqueName: \"kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.967537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.967537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.967753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.967753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.967753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.967653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:09.968125 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.968105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:09.977135 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:09.977104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq584\" (UniqueName: \"kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584\") pod \"payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:10.044054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.043976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:10.069103 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fh9\" (UniqueName: \"kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069447 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.069805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.069749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.071292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.071273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.071700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.071683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.078672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.078642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fh9\" (UniqueName: \"kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9\") pod \"autores-model-faa4c5-kserve-66bbf94747-qsk2x\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") " pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.083307 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.083280    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8110123-a75c-40fa-85cf-d825ddbe6848" path="/var/lib/kubelet/pods/c8110123-a75c-40fa-85cf-d825ddbe6848/volumes"
Sep 15 21:26:10.156331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.156298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:26:10.196818 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.196770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:10.217214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.217183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:10.219211 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:10.219185    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e80c8b_a1f4_4518_865e_59582fe8b052.slice/crio-3eb5a225b39a32507f744e45658e8b73a7781aa4d7790239349703eb2c666b7b WatchSource:0}: Error finding container 3eb5a225b39a32507f744e45658e8b73a7781aa4d7790239349703eb2c666b7b: Status 404 returned error can't find the container with id 3eb5a225b39a32507f744e45658e8b73a7781aa4d7790239349703eb2c666b7b
Sep 15 21:26:10.227000 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.226928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:10.316667 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.316631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:10.318624 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:10.318599    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47277dae_d5a3_4a1a_83d1_cc7cffac632b.slice/crio-b38202b58b83561adcc45973a6c6975ba072790863deee5a9509b41c08fcd515 WatchSource:0}: Error finding container b38202b58b83561adcc45973a6c6975ba072790863deee5a9509b41c08fcd515: Status 404 returned error can't find the container with id b38202b58b83561adcc45973a6c6975ba072790863deee5a9509b41c08fcd515
Sep 15 21:26:10.423272 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.423229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:10.504638 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.504611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:26:10.505598 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:10.505571    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod888285f5_7711_4e38_b2aa_2500f76c22b1.slice/crio-aa73b9a6a71fa86dd2f3a08575648c4745375304f2d87d21588f0c2110b7a08c WatchSource:0}: Error finding container aa73b9a6a71fa86dd2f3a08575648c4745375304f2d87d21588f0c2110b7a08c: Status 404 returned error can't find the container with id aa73b9a6a71fa86dd2f3a08575648c4745375304f2d87d21588f0c2110b7a08c
Sep 15 21:26:10.974164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:10.974131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:11.238370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.238252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" event={"ID":"88e80c8b-a1f4-4518-865e-59582fe8b052","Type":"ContainerStarted","Data":"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"}
Sep 15 21:26:11.238370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.238334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" event={"ID":"88e80c8b-a1f4-4518-865e-59582fe8b052","Type":"ContainerStarted","Data":"3eb5a225b39a32507f744e45658e8b73a7781aa4d7790239349703eb2c666b7b"}
Sep 15 21:26:11.238863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.238387    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:11.240353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.240275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" event={"ID":"888285f5-7711-4e38-b2aa-2500f76c22b1","Type":"ContainerStarted","Data":"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"}
Sep 15 21:26:11.240353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.240328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" event={"ID":"888285f5-7711-4e38-b2aa-2500f76c22b1","Type":"ContainerStarted","Data":"aa73b9a6a71fa86dd2f3a08575648c4745375304f2d87d21588f0c2110b7a08c"}
Sep 15 21:26:11.241986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.241952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" event={"ID":"47277dae-d5a3-4a1a-83d1-cc7cffac632b","Type":"ContainerStarted","Data":"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"}
Sep 15 21:26:11.242104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.242007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" event={"ID":"47277dae-d5a3-4a1a-83d1-cc7cffac632b","Type":"ContainerStarted","Data":"b38202b58b83561adcc45973a6c6975ba072790863deee5a9509b41c08fcd515"}
Sep 15 21:26:11.242173 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.242109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:11.256008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.255970    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" podStartSLOduration=2.255957827 podStartE2EDuration="2.255957827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:11.254745189 +0000 UTC m=+1065.659067235" watchObservedRunningTime="2026-09-15 21:26:11.255957827 +0000 UTC m=+1065.660279873"
Sep 15 21:26:11.272507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.272460    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" podStartSLOduration=2.272445882 podStartE2EDuration="2.272445882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:11.272115256 +0000 UTC m=+1065.676437303" watchObservedRunningTime="2026-09-15 21:26:11.272445882 +0000 UTC m=+1065.676767926"
Sep 15 21:26:11.290671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.290625    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" podStartSLOduration=2.290611496 podStartE2EDuration="2.290611496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:26:11.290009657 +0000 UTC m=+1065.694331704" watchObservedRunningTime="2026-09-15 21:26:11.290611496 +0000 UTC m=+1065.694933542"
Sep 15 21:26:11.804594 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:11.804555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:12.859362 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:12.859330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:13.641015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:13.640978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:19.264157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:19.264082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:20.227319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:20.227278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:20.227564 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:20.227543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:20.240206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:20.240173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:20.310566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:20.310537    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:26:21.339945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:21.339890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:22.250678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:22.250647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:22.250879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:22.250728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:27.827484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:27.827397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:28.158541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:28.158503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:26:31.203436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.203404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:31.386239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.386205    2560 generic.go:356] "Generic (PLEG): container finished" podID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerID="861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100" exitCode=0
Sep 15 21:26:31.386403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.386277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerDied","Data":"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"}
Sep 15 21:26:31.386671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.386651    2560 scope.go:117] "RemoveContainer" containerID="861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"
Sep 15 21:26:31.387802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.387774    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:31.387868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.387843    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:31.387903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.387883    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:31.551056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.550975    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"]
Sep 15 21:26:31.553708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.553692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:31.556491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.556471    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:26:31.571649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.571616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"]
Sep 15 21:26:31.685781 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.685733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-639cece9-647j6\" (UID: \"f82d3aa8-3ded-48d6-97ac-1e4afeef881b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:31.787320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.787277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-639cece9-647j6\" (UID: \"f82d3aa8-3ded-48d6-97ac-1e4afeef881b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:31.788120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.788095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-639cece9-647j6\" (UID: \"f82d3aa8-3ded-48d6-97ac-1e4afeef881b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:31.873372 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:31.873332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:32.152995 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.152962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"]
Sep 15 21:26:32.154267 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:32.154240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82d3aa8_3ded_48d6_97ac_1e4afeef881b.slice/crio-9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a WatchSource:0}: Error finding container 9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a: Status 404 returned error can't find the container with id 9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a
Sep 15 21:26:32.169388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.169363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:32.394362 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.394327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerStarted","Data":"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"}
Sep 15 21:26:32.395625 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.395605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6" event={"ID":"f82d3aa8-3ded-48d6-97ac-1e4afeef881b","Type":"ContainerStarted","Data":"9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a"}
Sep 15 21:26:32.802716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.802619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:32.803988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.803951    2560 patch_prober.go:28] interesting pod/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 15 21:26:32.804118 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.804017    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 15 21:26:32.982633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:32.982598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:33.406085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:33.406039    2560 generic.go:356] "Generic (PLEG): container finished" podID="f82d3aa8-3ded-48d6-97ac-1e4afeef881b" containerID="36e87079ebbb95ada8babb9dd5da0a5dc31f999916bb50b700f383299a646e36" exitCode=0
Sep 15 21:26:33.407244 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:33.407210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6" event={"ID":"f82d3aa8-3ded-48d6-97ac-1e4afeef881b","Type":"ContainerDied","Data":"36e87079ebbb95ada8babb9dd5da0a5dc31f999916bb50b700f383299a646e36"}
Sep 15 21:26:33.679056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:33.678962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:33.802912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:33.802868    2560 patch_prober.go:28] interesting pod/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 15 21:26:33.803141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:33.802969    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 15 21:26:34.383756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.383718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:34.574331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.574306    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:34.721819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.721685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca\") pod \"f82d3aa8-3ded-48d6-97ac-1e4afeef881b\" (UID: \"f82d3aa8-3ded-48d6-97ac-1e4afeef881b\") "
Sep 15 21:26:34.722335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.722294    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f82d3aa8-3ded-48d6-97ac-1e4afeef881b" (UID: "f82d3aa8-3ded-48d6-97ac-1e4afeef881b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:34.803269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.803218    2560 patch_prober.go:28] interesting pod/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 15 21:26:34.803582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.803534    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 15 21:26:34.822751 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:34.822690    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82d3aa8-3ded-48d6-97ac-1e4afeef881b-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:35.262800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.262763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.426165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.426118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6" event={"ID":"f82d3aa8-3ded-48d6-97ac-1e4afeef881b","Type":"ContainerDied","Data":"9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a"}
Sep 15 21:26:35.426165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.426147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"
Sep 15 21:26:35.426434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.426185    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f1cc5f3d6d4dd3c21538a9a2fdf20477a3087facef2a29e76f4aa68d5cd8d7a"
Sep 15 21:26:35.803185 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.803130    2560 patch_prober.go:28] interesting pod/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 15 21:26:35.803685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.803217    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 15 21:26:35.989211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:35.989175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.720533 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:36.720312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.802649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:36.802611    2560 patch_prober.go:28] interesting pod/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 15 21:26:36.802967 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:36.802912    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 15 21:26:37.205829 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:37.205769    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:37.806671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:37.806638    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:37.807602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:37.807582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:38.429099 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:38.429056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.075780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.075750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.113303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.113269    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:39.113504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.113478    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" podUID="88e80c8b-a1f4-4518-865e-59582fe8b052" containerName="payload-processing" containerID="cri-o://bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944" gracePeriod=30
Sep 15 21:26:39.121234 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.121089    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:39.121551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.121523    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" podUID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" containerName="payload-pre-processing" containerID="cri-o://4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea" gracePeriod=30
Sep 15 21:26:39.156219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.156186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.235574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.235545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.292148 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.292113    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"]
Sep 15 21:26:39.296672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.296644    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-639cece9-647j6"]
Sep 15 21:26:39.309430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.309400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.373378 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.373350    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:39.396891 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.396863    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:39.450283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.450251    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:39.452048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.452021    2560 generic.go:356] "Generic (PLEG): container finished" podID="88e80c8b-a1f4-4518-865e-59582fe8b052" containerID="bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944" exitCode=0
Sep 15 21:26:39.452183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.452043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" event={"ID":"88e80c8b-a1f4-4518-865e-59582fe8b052","Type":"ContainerDied","Data":"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"}
Sep 15 21:26:39.452183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.452072    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"
Sep 15 21:26:39.452183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.452087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t" event={"ID":"88e80c8b-a1f4-4518-865e-59582fe8b052","Type":"ContainerDied","Data":"3eb5a225b39a32507f744e45658e8b73a7781aa4d7790239349703eb2c666b7b"}
Sep 15 21:26:39.452183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.452109    2560 scope.go:117] "RemoveContainer" containerID="bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"
Sep 15 21:26:39.453405 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.453387    2560 generic.go:356] "Generic (PLEG): container finished" podID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" containerID="4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea" exitCode=0
Sep 15 21:26:39.453478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.453433    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"
Sep 15 21:26:39.453522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.453470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" event={"ID":"47277dae-d5a3-4a1a-83d1-cc7cffac632b","Type":"ContainerDied","Data":"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"}
Sep 15 21:26:39.453522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.453509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc" event={"ID":"47277dae-d5a3-4a1a-83d1-cc7cffac632b","Type":"ContainerDied","Data":"b38202b58b83561adcc45973a6c6975ba072790863deee5a9509b41c08fcd515"}
Sep 15 21:26:39.453720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.453703    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy" containerID="cri-o://9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6" gracePeriod=30
Sep 15 21:26:39.461524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.461503    2560 scope.go:117] "RemoveContainer" containerID="bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"
Sep 15 21:26:39.461851 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:39.461827    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944\": container with ID starting with bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944 not found: ID does not exist" containerID="bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"
Sep 15 21:26:39.461908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.461863    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944"} err="failed to get container status \"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944\": rpc error: code = NotFound desc = could not find container \"bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944\": container with ID starting with bdd0cd8c9ec3ec14a1176a8f4c6177673b678b8f77ca4d16340ee3f2b8274944 not found: ID does not exist"
Sep 15 21:26:39.461908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.461888    2560 scope.go:117] "RemoveContainer" containerID="4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"
Sep 15 21:26:39.464588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.464566    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume\") pod \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") "
Sep 15 21:26:39.464695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.464607    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume\") pod \"88e80c8b-a1f4-4518-865e-59582fe8b052\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") "
Sep 15 21:26:39.464695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.464659    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g65t2\" (UniqueName: \"kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2\") pod \"88e80c8b-a1f4-4518-865e-59582fe8b052\" (UID: \"88e80c8b-a1f4-4518-865e-59582fe8b052\") "
Sep 15 21:26:39.464841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.464756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq584\" (UniqueName: \"kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584\") pod \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\" (UID: \"47277dae-d5a3-4a1a-83d1-cc7cffac632b\") "
Sep 15 21:26:39.465037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.465010    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47277dae-d5a3-4a1a-83d1-cc7cffac632b" (UID: "47277dae-d5a3-4a1a-83d1-cc7cffac632b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:39.465112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.465045    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88e80c8b-a1f4-4518-865e-59582fe8b052" (UID: "88e80c8b-a1f4-4518-865e-59582fe8b052"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:39.467019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.466925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2" (OuterVolumeSpecName: "kube-api-access-g65t2") pod "88e80c8b-a1f4-4518-865e-59582fe8b052" (UID: "88e80c8b-a1f4-4518-865e-59582fe8b052"). InnerVolumeSpecName "kube-api-access-g65t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:39.467108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.467061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584" (OuterVolumeSpecName: "kube-api-access-lq584") pod "47277dae-d5a3-4a1a-83d1-cc7cffac632b" (UID: "47277dae-d5a3-4a1a-83d1-cc7cffac632b"). InnerVolumeSpecName "kube-api-access-lq584". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:39.469633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.469607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.471320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.471294    2560 scope.go:117] "RemoveContainer" containerID="4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"
Sep 15 21:26:39.471586 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:39.471565    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea\": container with ID starting with 4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea not found: ID does not exist" containerID="4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"
Sep 15 21:26:39.471654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.471593    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea"} err="failed to get container status \"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea\": rpc error: code = NotFound desc = could not find container \"4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea\": container with ID starting with 4bb4557439e7a292aa03131a17c4310c91bd193a2abd259cfd0cbab9cc49d9ea not found: ID does not exist"
Sep 15 21:26:39.566347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.566311    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq584\" (UniqueName: \"kubernetes.io/projected/47277dae-d5a3-4a1a-83d1-cc7cffac632b-kube-api-access-lq584\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:39.566347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.566342    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47277dae-d5a3-4a1a-83d1-cc7cffac632b-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:39.566347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.566351    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e80c8b-a1f4-4518-865e-59582fe8b052-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:39.566579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.566359    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g65t2\" (UniqueName: \"kubernetes.io/projected/88e80c8b-a1f4-4518-865e-59582fe8b052-kube-api-access-g65t2\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:39.782664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.782628    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:39.798857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.798809    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-639cece9-6b597f5ccd-v5mdc"]
Sep 15 21:26:39.810969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.810928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.818847 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.818817    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:39.828405 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:39.828377    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-639cece9-54977d7db9-mk24t"]
Sep 15 21:26:40.084819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:40.084720    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" path="/var/lib/kubelet/pods/47277dae-d5a3-4a1a-83d1-cc7cffac632b/volumes"
Sep 15 21:26:40.085162 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:40.085148    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e80c8b-a1f4-4518-865e-59582fe8b052" path="/var/lib/kubelet/pods/88e80c8b-a1f4-4518-865e-59582fe8b052/volumes"
Sep 15 21:26:40.085450 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:40.085439    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82d3aa8-3ded-48d6-97ac-1e4afeef881b" path="/var/lib/kubelet/pods/f82d3aa8-3ded-48d6-97ac-1e4afeef881b/volumes"
Sep 15 21:26:40.182518 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:40.182471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:40.320040 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:40.320004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.203922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:41.203840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.769301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:41.769236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:42.039597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039519    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"]
Sep 15 21:26:42.039914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039902    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e80c8b-a1f4-4518-865e-59582fe8b052" containerName="payload-processing"
Sep 15 21:26:42.039976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039916    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e80c8b-a1f4-4518-865e-59582fe8b052" containerName="payload-processing"
Sep 15 21:26:42.039976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039950    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" containerName="payload-pre-processing"
Sep 15 21:26:42.039976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039956    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" containerName="payload-pre-processing"
Sep 15 21:26:42.039976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039967    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82d3aa8-3ded-48d6-97ac-1e4afeef881b" containerName="revoke-keys"
Sep 15 21:26:42.039976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.039973    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82d3aa8-3ded-48d6-97ac-1e4afeef881b" containerName="revoke-keys"
Sep 15 21:26:42.040137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.040037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e80c8b-a1f4-4518-865e-59582fe8b052" containerName="payload-processing"
Sep 15 21:26:42.040137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.040046    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="47277dae-d5a3-4a1a-83d1-cc7cffac632b" containerName="payload-pre-processing"
Sep 15 21:26:42.040137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.040054    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82d3aa8-3ded-48d6-97ac-1e4afeef881b" containerName="revoke-keys"
Sep 15 21:26:42.043077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.043057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:42.045588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.045570    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:26:42.053264 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.053239    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"]
Sep 15 21:26:42.089074 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.089041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp\" (UID: \"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:42.110580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.110547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:42.190175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.190138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp\" (UID: \"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:42.190736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.190717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp\" (UID: \"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:42.353297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.353267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:42.624451 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.624426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"]
Sep 15 21:26:42.626165 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:26:42.626136    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcb0f09_91ae_4963_92ae_d10b02ae6ea3.slice/crio-d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3 WatchSource:0}: Error finding container d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3: Status 404 returned error can't find the container with id d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3
Sep 15 21:26:42.897607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:42.897515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:43.481897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:43.481810    2560 generic.go:356] "Generic (PLEG): container finished" podID="2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" containerID="c195bb16560af3d99b72eca8d3068ced93b6155e97508faf23cbd0538882f182" exitCode=0
Sep 15 21:26:43.482270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:43.481889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp" event={"ID":"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3","Type":"ContainerDied","Data":"c195bb16560af3d99b72eca8d3068ced93b6155e97508faf23cbd0538882f182"}
Sep 15 21:26:43.482270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:43.481959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp" event={"ID":"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3","Type":"ContainerStarted","Data":"d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3"}
Sep 15 21:26:43.813528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:43.813440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.626503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.626478    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:44.691365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.691329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.710760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.710729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:44.712607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.712584    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca\") pod \"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3\" (UID: \"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3\") "
Sep 15 21:26:44.713035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.712983    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" (UID: "2fcb0f09-91ae-4963-92ae-d10b02ae6ea3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:44.813888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.813852    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.813896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.813915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfqg5\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.813973    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814143    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs\") pod \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\" (UID: \"a31d95e1-85d1-41e3-bd33-9b4849f05c69\") "
Sep 15 21:26:44.814427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814233    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:44.814427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814407    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data" (OuterVolumeSpecName: "istio-data") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:44.814619 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:44.814619 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814552    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:44.814619 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814563    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.814767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:44.814767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814631    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.814767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814647    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.814767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.814673    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.816247 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.816221    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5" (OuterVolumeSpecName: "kube-api-access-bfqg5") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "kube-api-access-bfqg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:44.816360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.816295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:26:44.816360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.816323    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token" (OuterVolumeSpecName: "istio-token") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:44.816360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.816329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a31d95e1-85d1-41e3-bd33-9b4849f05c69" (UID: "a31d95e1-85d1-41e3-bd33-9b4849f05c69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:44.916044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916005    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.916044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916039    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfqg5\" (UniqueName: \"kubernetes.io/projected/a31d95e1-85d1-41e3-bd33-9b4849f05c69-kube-api-access-bfqg5\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.916044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916053    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.916281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916063    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.916281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916074    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a31d95e1-85d1-41e3-bd33-9b4849f05c69-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:44.916281 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:44.916085    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a31d95e1-85d1-41e3-bd33-9b4849f05c69-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:45.499896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.499867    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"
Sep 15 21:26:45.500064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.499896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp" event={"ID":"2fcb0f09-91ae-4963-92ae-d10b02ae6ea3","Type":"ContainerDied","Data":"d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3"}
Sep 15 21:26:45.500064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.499967    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0ad79dcfe46749c6383a9df7c26d39573f588895919183dbaa4f286716a04a3"
Sep 15 21:26:45.501659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.501637    2560 generic.go:356] "Generic (PLEG): container finished" podID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerID="9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6" exitCode=0
Sep 15 21:26:45.501785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.501677    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"
Sep 15 21:26:45.501785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.501688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerDied","Data":"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"}
Sep 15 21:26:45.501785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.501723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf" event={"ID":"a31d95e1-85d1-41e3-bd33-9b4849f05c69","Type":"ContainerDied","Data":"fca3f2aa999a0bdb5e8bd8adc304d4651b7b69f841fcd8757e3162796cc8d758"}
Sep 15 21:26:45.501785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.501745    2560 scope.go:117] "RemoveContainer" containerID="9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"
Sep 15 21:26:45.511710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.511693    2560 scope.go:117] "RemoveContainer" containerID="861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"
Sep 15 21:26:45.520251 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.520232    2560 scope.go:117] "RemoveContainer" containerID="9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"
Sep 15 21:26:45.520535 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:45.520516    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6\": container with ID starting with 9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6 not found: ID does not exist" containerID="9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"
Sep 15 21:26:45.520583 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.520543    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6"} err="failed to get container status \"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6\": rpc error: code = NotFound desc = could not find container \"9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6\": container with ID starting with 9dd3917fd52d981e676b2c0534117792994c747f16dfa510d8bcbad59b148fe6 not found: ID does not exist"
Sep 15 21:26:45.520583 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.520560    2560 scope.go:117] "RemoveContainer" containerID="861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"
Sep 15 21:26:45.520804 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:45.520785    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100\": container with ID starting with 861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100 not found: ID does not exist" containerID="861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"
Sep 15 21:26:45.520852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.520810    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100"} err="failed to get container status \"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100\": rpc error: code = NotFound desc = could not find container \"861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100\": container with ID starting with 861998fbbcd35cc98e5ed7c95aa5a8f8614bbf415cf48e6cff2f809a0a3f0100 not found: ID does not exist"
Sep 15 21:26:45.528884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.528857    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:45.532746 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.532725    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-639cece9-openshift-default-7c4c54fd56-9wclf"]
Sep 15 21:26:45.598284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:45.598256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:46.082524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:46.082493    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" path="/var/lib/kubelet/pods/a31d95e1-85d1-41e3-bd33-9b4849f05c69/volumes"
Sep 15 21:26:46.341074 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:46.340973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:46.850734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:46.850701    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:26:47.060093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:47.060056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:47.895696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:47.895660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:48.416343 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:48.416309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:48.514758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:48.514727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:48.653584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:48.653545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:52.703178 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.703141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:52.739886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.739856    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:26:52.740108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.740079    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" podUID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" containerName="payload-processing" containerID="cri-o://2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52" gracePeriod=30
Sep 15 21:26:52.801203 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.801170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:52.903062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.903026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:52.943853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.943821    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"]
Sep 15 21:26:52.947951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.947908    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-faa4c5-lbbmp"]
Sep 15 21:26:52.999721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:52.999691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:26:53.000369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.000347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:53.091358 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.091320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92bdc\" (UniqueName: \"kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc\") pod \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") "
Sep 15 21:26:53.091540 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.091384    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume\") pod \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\" (UID: \"0e0f40ac-f4c9-40e6-8be5-89f8717993ee\") "
Sep 15 21:26:53.091802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.091779    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e0f40ac-f4c9-40e6-8be5-89f8717993ee" (UID: "0e0f40ac-f4c9-40e6-8be5-89f8717993ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:53.093513 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.093492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc" (OuterVolumeSpecName: "kube-api-access-92bdc") pod "0e0f40ac-f4c9-40e6-8be5-89f8717993ee" (UID: "0e0f40ac-f4c9-40e6-8be5-89f8717993ee"). InnerVolumeSpecName "kube-api-access-92bdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:53.192096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.192056    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92bdc\" (UniqueName: \"kubernetes.io/projected/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-kube-api-access-92bdc\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:53.192096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.192091    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0f40ac-f4c9-40e6-8be5-89f8717993ee-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:26:53.307258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.307168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:53.412258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.412222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:53.549263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.549225    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" containerID="2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52" exitCode=0
Sep 15 21:26:53.549423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.549276    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"
Sep 15 21:26:53.549423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.549321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" event={"ID":"0e0f40ac-f4c9-40e6-8be5-89f8717993ee","Type":"ContainerDied","Data":"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"}
Sep 15 21:26:53.549423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.549372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw" event={"ID":"0e0f40ac-f4c9-40e6-8be5-89f8717993ee","Type":"ContainerDied","Data":"877fa795d6e110860b0fcd85c8e7de4c47835bc2b37ef368d49fa5c6bf3f22c1"}
Sep 15 21:26:53.549423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.549394    2560 scope.go:117] "RemoveContainer" containerID="2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"
Sep 15 21:26:53.559067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.559041    2560 scope.go:117] "RemoveContainer" containerID="2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"
Sep 15 21:26:53.559341 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:26:53.559320    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52\": container with ID starting with 2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52 not found: ID does not exist" containerID="2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"
Sep 15 21:26:53.559382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.559349    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52"} err="failed to get container status \"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52\": rpc error: code = NotFound desc = could not find container \"2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52\": container with ID starting with 2e926fd294a7aebd9a632274da1697195c261ee1c554a87baa5937ee04c00d52 not found: ID does not exist"
Sep 15 21:26:53.571985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.571958    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:26:53.575548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:53.575527    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-faa4c5-795785477c-9k6kw"]
Sep 15 21:26:54.082243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:54.082210    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" path="/var/lib/kubelet/pods/0e0f40ac-f4c9-40e6-8be5-89f8717993ee/volumes"
Sep 15 21:26:54.082605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:54.082539    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" path="/var/lib/kubelet/pods/2fcb0f09-91ae-4963-92ae-d10b02ae6ea3/volumes"
Sep 15 21:26:54.283529 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:54.283492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:55.196653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:55.196608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:55.891603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:55.891567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:56.649092 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:56.649063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:58.285135 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:58.285099    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:26:58.380366 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:58.380327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:58.792037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:26:58.792005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:08.052279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:08.052245    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:27:13.304374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.304316    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" podUID="888285f5-7711-4e38-b2aa-2500f76c22b1" containerName="main" containerID="cri-o://6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22" gracePeriod=45
Sep 15 21:27:13.562719 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.562658    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:27:13.667336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.667299    2560 generic.go:356] "Generic (PLEG): container finished" podID="888285f5-7711-4e38-b2aa-2500f76c22b1" containerID="6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22" exitCode=0
Sep 15 21:27:13.667501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.667345    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"
Sep 15 21:27:13.667501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.667381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" event={"ID":"888285f5-7711-4e38-b2aa-2500f76c22b1","Type":"ContainerDied","Data":"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"}
Sep 15 21:27:13.667501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.667425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x" event={"ID":"888285f5-7711-4e38-b2aa-2500f76c22b1","Type":"ContainerDied","Data":"aa73b9a6a71fa86dd2f3a08575648c4745375304f2d87d21588f0c2110b7a08c"}
Sep 15 21:27:13.667501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.667442    2560 scope.go:117] "RemoveContainer" containerID="6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"
Sep 15 21:27:13.676432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.676403    2560 scope.go:117] "RemoveContainer" containerID="6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"
Sep 15 21:27:13.676680 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:27:13.676660    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22\": container with ID starting with 6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22 not found: ID does not exist" containerID="6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"
Sep 15 21:27:13.676769 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.676693    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22"} err="failed to get container status \"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22\": rpc error: code = NotFound desc = could not find container \"6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22\": container with ID starting with 6c12b95784605a2b50ec431172384b316ba6399d211f955bb4b730048ad06f22 not found: ID does not exist"
Sep 15 21:27:13.688996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.688970    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689091 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689097    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8fh9\" (UniqueName: \"kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689176 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home" (OuterVolumeSpecName: "home") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:13.689288 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689351 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs\") pod \"888285f5-7711-4e38-b2aa-2500f76c22b1\" (UID: \"888285f5-7711-4e38-b2aa-2500f76c22b1\") "
Sep 15 21:27:13.689406 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:13.689406 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689353    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:13.689643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689627    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.689697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689647    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.689697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.689660    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.691233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.691204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9" (OuterVolumeSpecName: "kube-api-access-g8fh9") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "kube-api-access-g8fh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:27:13.691320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.691259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm" (OuterVolumeSpecName: "dshm") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:13.691320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.691295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "888285f5-7711-4e38-b2aa-2500f76c22b1" (UID: "888285f5-7711-4e38-b2aa-2500f76c22b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:27:13.790504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.790465    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/888285f5-7711-4e38-b2aa-2500f76c22b1-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.790504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.790498    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/888285f5-7711-4e38-b2aa-2500f76c22b1-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.790504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.790512    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8fh9\" (UniqueName: \"kubernetes.io/projected/888285f5-7711-4e38-b2aa-2500f76c22b1-kube-api-access-g8fh9\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:27:13.993634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.993603    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:27:13.997404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:13.997379    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-faa4c5/autores-model-faa4c5-kserve-66bbf94747-qsk2x"]
Sep 15 21:27:14.082799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:14.082769    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888285f5-7711-4e38-b2aa-2500f76c22b1" path="/var/lib/kubelet/pods/888285f5-7711-4e38-b2aa-2500f76c22b1/volumes"
Sep 15 21:27:14.544587 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:14.544549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:16.834541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834500    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:27:16.834948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834909    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" containerName="revoke-keys"
Sep 15 21:27:16.834948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834924    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" containerName="revoke-keys"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834979    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888285f5-7711-4e38-b2aa-2500f76c22b1" containerName="main"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834986    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="888285f5-7711-4e38-b2aa-2500f76c22b1" containerName="main"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834994    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.834999    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835006    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" containerName="payload-processing"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" containerName="payload-processing"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835022    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:16.835039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835027    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:16.835295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835109    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="888285f5-7711-4e38-b2aa-2500f76c22b1" containerName="main"
Sep 15 21:27:16.835295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835119    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcb0f09-91ae-4963-92ae-d10b02ae6ea3" containerName="revoke-keys"
Sep 15 21:27:16.835295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835128    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e0f40ac-f4c9-40e6-8be5-89f8717993ee" containerName="payload-processing"
Sep 15 21:27:16.835295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.835134    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:16.838072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.838054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:16.840774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.840738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a276f9\"/\"premium-w0-a276f9-kserve-self-signed-certs\""
Sep 15 21:27:16.851143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:16.851118    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:27:17.020064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97zm6\" (UniqueName: \"kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.020064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.020269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.020269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.020269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.020269 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.020219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97zm6\" (UniqueName: \"kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.121890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.121871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.122232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.122209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.122282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.122226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.122282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.122258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.123857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.123840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.124326 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.124308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.131031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.131014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97zm6\" (UniqueName: \"kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6\") pod \"premium-w0-a276f9-kserve-565c8c7957-g4xjp\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") " pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.133052 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.133030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:17.147625 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.147601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:17.418339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.418310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:27:17.419826 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:27:17.419801    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00dcf703_c6b7_40da_8214_7282ee64aff1.slice/crio-c1e32dbed908616103d71866af8c94f42a0504df328546308218f815c2c7e58d WatchSource:0}: Error finding container c1e32dbed908616103d71866af8c94f42a0504df328546308218f815c2c7e58d: Status 404 returned error can't find the container with id c1e32dbed908616103d71866af8c94f42a0504df328546308218f815c2c7e58d
Sep 15 21:27:17.693011 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.692899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" event={"ID":"00dcf703-c6b7-40da-8214-7282ee64aff1","Type":"ContainerStarted","Data":"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"}
Sep 15 21:27:17.693011 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.692959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" event={"ID":"00dcf703-c6b7-40da-8214-7282ee64aff1","Type":"ContainerStarted","Data":"c1e32dbed908616103d71866af8c94f42a0504df328546308218f815c2c7e58d"}
Sep 15 21:27:17.710732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:17.710685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" podStartSLOduration=1.710669124 podStartE2EDuration="1.710669124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:17.708646973 +0000 UTC m=+1132.112969020" watchObservedRunningTime="2026-09-15 21:27:17.710669124 +0000 UTC m=+1132.114991169"
Sep 15 21:27:20.601074 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:20.601035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:20.685127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:20.685098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:20.813767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:20.813728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:21.450078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:21.450040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:27:27.148446 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:27.148406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:27.148877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:27.148477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:27.161300 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:27.161269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:27.761224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:27.761193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:27:32.923834 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.923796    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:27:32.924332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.924295    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31d95e1-85d1-41e3-bd33-9b4849f05c69" containerName="istio-proxy"
Sep 15 21:27:32.927496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.927475    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.930469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.930447    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"openshift-service-ca.crt\""
Sep 15 21:27:32.930607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.930512    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"kube-root-ca.crt\""
Sep 15 21:27:32.931777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.931759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"premium-w4-625609-kserve-self-signed-certs\""
Sep 15 21:27:32.931868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.931784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"default-dockercfg-dzqv9\""
Sep 15 21:27:32.937592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.937565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:27:32.955181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.955152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:32.973441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.973549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.973549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmmzt\" (UniqueName: \"kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.973549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.973675 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:32.973675 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:32.973603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.074782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.074738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.074782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.074786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmzt\" (UniqueName: \"kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.074898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.074984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.075027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075225 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.075103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.075343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.075381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.075505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.075454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.077145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.077123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.077351 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.077332    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.082917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.082890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmmzt\" (UniqueName: \"kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt\") pod \"premium-w4-625609-kserve-7688647db4-5ph4r\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") " pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.239002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.238877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:33.507859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.507832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:27:33.509489 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:27:33.509454    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b020730_d895_41ee_ad41_c48c3ad51371.slice/crio-5bcd22b061e0a0df9de990c2a206c0ae79daa4703d409c7de686d9284cd0f599 WatchSource:0}: Error finding container 5bcd22b061e0a0df9de990c2a206c0ae79daa4703d409c7de686d9284cd0f599: Status 404 returned error can't find the container with id 5bcd22b061e0a0df9de990c2a206c0ae79daa4703d409c7de686d9284cd0f599
Sep 15 21:27:33.785380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.785293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" event={"ID":"6b020730-d895-41ee-ad41-c48c3ad51371","Type":"ContainerStarted","Data":"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"}
Sep 15 21:27:33.785380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.785334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" event={"ID":"6b020730-d895-41ee-ad41-c48c3ad51371","Type":"ContainerStarted","Data":"5bcd22b061e0a0df9de990c2a206c0ae79daa4703d409c7de686d9284cd0f599"}
Sep 15 21:27:33.803020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:33.802971    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" podStartSLOduration=1.802956491 podStartE2EDuration="1.802956491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:33.801514992 +0000 UTC m=+1148.205837040" watchObservedRunningTime="2026-09-15 21:27:33.802956491 +0000 UTC m=+1148.207278534"
Sep 15 21:27:35.016120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:35.016083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:35.275493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:35.275407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:35.729132 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:35.729045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:36.273580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:36.273527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:36.338589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:36.338558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:36.647441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:36.647410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:38.094600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:38.094567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:38.163716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:38.163677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:27:38.754300 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:38.754266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:38.849574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:38.849539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:38.949573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:38.949536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:40.105567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:40.105536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:40.793445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:40.793414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:41.567755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:41.567718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.409463 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.409428    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.510283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.510242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.627019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.626981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.872074 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.872044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.969808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.969755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:42.976922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.976888    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:27:42.979459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.979442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:42.982025 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.982002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-928184\""
Sep 15 21:27:42.991915 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:42.991888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:27:43.007244 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.007217    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:27:43.009834 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.009812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.012563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.012544    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-928184-dockercfg-8v4f9\""
Sep 15 21:27:43.020947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.020909    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:27:43.073017 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.072978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.073190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.073087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlwz\" (UniqueName: \"kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.174306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.174215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.174306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.174259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flr42\" (UniqueName: \"kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.174496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.174365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.174496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.174472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlwz\" (UniqueName: \"kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.175192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.175175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.183465 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.183443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlwz\" (UniqueName: \"kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz\") pod \"payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.239346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.239310    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:43.239519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.239498    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:43.252120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.252090    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:43.275278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.275247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.275425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.275289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flr42\" (UniqueName: \"kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.275919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.275900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.285824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.285798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flr42\" (UniqueName: \"kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42\") pod \"payload-processing-e2e-explicit-928184-596f55f56f-krq5d\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") " pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.291612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.291589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.321064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.321031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.410755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.410721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:43.510540 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.510460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:43.577702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.577672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:27:43.580642 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:27:43.580612    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a28ab0_16a1_48b2_8b78_9185db588ba6.slice/crio-5699bedc393b8836f679e5e03808b30ccaa19ff70a33b6ce85496f485c3db27e WatchSource:0}: Error finding container 5699bedc393b8836f679e5e03808b30ccaa19ff70a33b6ce85496f485c3db27e: Status 404 returned error can't find the container with id 5699bedc393b8836f679e5e03808b30ccaa19ff70a33b6ce85496f485c3db27e
Sep 15 21:27:43.604830 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.604802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:27:43.606031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.606010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:43.609131 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:27:43.609109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f3a506_27b1_462d_93f7_bcdedc43f712.slice/crio-6612b1965f9978d55e79879b02540b412298e367da225ba3ba74f4ad5b3ad693 WatchSource:0}: Error finding container 6612b1965f9978d55e79879b02540b412298e367da225ba3ba74f4ad5b3ad693: Status 404 returned error can't find the container with id 6612b1965f9978d55e79879b02540b412298e367da225ba3ba74f4ad5b3ad693
Sep 15 21:27:43.678192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.678148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:43.844640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.844541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" event={"ID":"c3f3a506-27b1-462d-93f7-bcdedc43f712","Type":"ContainerStarted","Data":"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"}
Sep 15 21:27:43.844640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.844601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" event={"ID":"c3f3a506-27b1-462d-93f7-bcdedc43f712","Type":"ContainerStarted","Data":"6612b1965f9978d55e79879b02540b412298e367da225ba3ba74f4ad5b3ad693"}
Sep 15 21:27:43.844896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.844718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:43.846565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.846544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" event={"ID":"b3a28ab0-16a1-48b2-8b78-9185db588ba6","Type":"ContainerStarted","Data":"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"}
Sep 15 21:27:43.846684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.846584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" event={"ID":"b3a28ab0-16a1-48b2-8b78-9185db588ba6","Type":"ContainerStarted","Data":"5699bedc393b8836f679e5e03808b30ccaa19ff70a33b6ce85496f485c3db27e"}
Sep 15 21:27:43.846684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.846623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:43.858880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.858858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:27:43.866896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.866850    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" podStartSLOduration=1.866833727 podStartE2EDuration="1.866833727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:43.862491112 +0000 UTC m=+1158.266813157" watchObservedRunningTime="2026-09-15 21:27:43.866833727 +0000 UTC m=+1158.271155774"
Sep 15 21:27:43.880649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:43.880602    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" podStartSLOduration=1.8805862119999999 podStartE2EDuration="1.880586212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:43.879657925 +0000 UTC m=+1158.283979972" watchObservedRunningTime="2026-09-15 21:27:43.880586212 +0000 UTC m=+1158.284908258"
Sep 15 21:27:49.314980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:49.314854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:52.757472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:52.757432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:27:54.101658 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:54.101625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:54.854426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:54.854392    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:27:54.854627 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:54.854605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:27:54.926335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:27:54.926299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:00.857402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:00.857351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:00.928471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:00.928437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:01.008134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:01.008100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:01.109182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:01.109083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:01.207683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:01.207646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:01.832710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:01.832623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:01.927806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:01.927768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:02.026888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:02.026853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:03.598572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:03.598538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:04.604084 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:04.604049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:05.377541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:05.377505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:06.142271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:06.142230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:06.980573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:06.980536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:07.812963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:07.812906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:08.674058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:08.674023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:08.793062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:08.793016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:09.787351 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:09.787312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:09.887639 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:09.887600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:10.447531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:10.447498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.556783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:12.556730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:28:16.273648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.273608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:16.348736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.348670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:16.511361 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.511322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:16.800906 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.800871    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:28:16.805732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.805709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.808433 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.808411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 21:28:16.808560 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.808420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-11b5978b-openshift-default-dockercfg-p45cg\""
Sep 15 21:28:16.817886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.817852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:28:16.830280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.830240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:16.896365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.896617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.896782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.896855 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.896922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.896922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7p7\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.897053 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.896983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.897109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.897056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.897109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.897092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7p7\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.998873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.999029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.998996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.999319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.999282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.999431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.999305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.999431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.999342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:16.999431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:16.999353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.000811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.000780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.001265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.001244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.007553 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.007524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.007664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.007646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7p7\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7\") pod \"e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") " pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.118445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.118408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:17.212086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.212022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:17.500977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.500905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:28:17.503286 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:28:17.503259    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523f60d5_a70e_4126_871b_e10ab191543d.slice/crio-f866945721697c5e947e85e43fabfebc6826a17ae3417bd89f4ddd7e7992db9b WatchSource:0}: Error finding container f866945721697c5e947e85e43fabfebc6826a17ae3417bd89f4ddd7e7992db9b: Status 404 returned error can't find the container with id f866945721697c5e947e85e43fabfebc6826a17ae3417bd89f4ddd7e7992db9b
Sep 15 21:28:17.505650 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.505608    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:17.505736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.505701    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:17.505777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:17.505744    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:18.064007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:18.063967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerStarted","Data":"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"}
Sep 15 21:28:18.064157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:18.064050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerStarted","Data":"f866945721697c5e947e85e43fabfebc6826a17ae3417bd89f4ddd7e7992db9b"}
Sep 15 21:28:18.118765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:18.118732    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:18.123721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:18.123699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:18.179693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:18.179637    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podStartSLOduration=2.179617201 podStartE2EDuration="2.179617201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:18.106347372 +0000 UTC m=+1192.510669418" watchObservedRunningTime="2026-09-15 21:28:18.179617201 +0000 UTC m=+1192.583939248"
Sep 15 21:28:19.070846 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:19.070816    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:19.071812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:19.071786    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:21.009003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:21.008973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:22.895301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:22.895265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:24.980580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:24.980538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:25.615014 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:25.614958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:26.145787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:26.145758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:28:26.148166 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:26.148138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:28:26.359429 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:26.359395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:27.118643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:27.118608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:27.827366 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:27.827334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:27.924111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:27.924070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:28.310890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.310857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:28.415000 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.414964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:28.511305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.511272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:28:28.514783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.514764    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.517730 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.517705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-11b5978b-dockercfg-kp64l\""
Sep 15 21:28:28.517730 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.517729    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-11b5978b\""
Sep 15 21:28:28.525650 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.525626    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:28:28.604951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.604905    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:28:28.608579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.608538    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.616674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.616648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:28:28.618712 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.618683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.618837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.618781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswqf\" (UniqueName: \"kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.719379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.719341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.719541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.719389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswqf\" (UniqueName: \"kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.719541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.719493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.719541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.719531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drpjn\" (UniqueName: \"kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.720288 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.720266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.727461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.727422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswqf\" (UniqueName: \"kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf\") pod \"payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.820333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.820296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drpjn\" (UniqueName: \"kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.820496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.820363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.821129 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.821110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.825995 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.825963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:28.828449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.828419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drpjn\" (UniqueName: \"kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn\") pod \"payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") " pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:28.921204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:28.921165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:29.098833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:29.098802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:28:29.099985 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:28:29.099957    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ce3750_6b63_4458_8191_5ec173a36bba.slice/crio-0886f1f5a0c9d78f8ad3d8432f3fb571be67d0298ff32f100e42f61574d2b7ec WatchSource:0}: Error finding container 0886f1f5a0c9d78f8ad3d8432f3fb571be67d0298ff32f100e42f61574d2b7ec: Status 404 returned error can't find the container with id 0886f1f5a0c9d78f8ad3d8432f3fb571be67d0298ff32f100e42f61574d2b7ec
Sep 15 21:28:29.131358 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:29.131299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" event={"ID":"c8ce3750-6b63-4458-8191-5ec173a36bba","Type":"ContainerStarted","Data":"0886f1f5a0c9d78f8ad3d8432f3fb571be67d0298ff32f100e42f61574d2b7ec"}
Sep 15 21:28:29.196736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:29.196700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:28:29.198140 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:28:29.198113    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f3f6b9_3404_4032_8553_7c0e26425145.slice/crio-d60d1e2222264a6c7db37c21b039cb66775814e0bc26dd39816ec7c9a35282d1 WatchSource:0}: Error finding container d60d1e2222264a6c7db37c21b039cb66775814e0bc26dd39816ec7c9a35282d1: Status 404 returned error can't find the container with id d60d1e2222264a6c7db37c21b039cb66775814e0bc26dd39816ec7c9a35282d1
Sep 15 21:28:30.139280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.139238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" event={"ID":"c8ce3750-6b63-4458-8191-5ec173a36bba","Type":"ContainerStarted","Data":"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"}
Sep 15 21:28:30.139745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.139308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:30.141092 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.141065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" event={"ID":"55f3f6b9-3404-4032-8553-7c0e26425145","Type":"ContainerStarted","Data":"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"}
Sep 15 21:28:30.141194 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.141118    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:30.141194 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.141138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" event={"ID":"55f3f6b9-3404-4032-8553-7c0e26425145","Type":"ContainerStarted","Data":"d60d1e2222264a6c7db37c21b039cb66775814e0bc26dd39816ec7c9a35282d1"}
Sep 15 21:28:30.157117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.157067    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" podStartSLOduration=2.157052722 podStartE2EDuration="2.157052722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:30.154442015 +0000 UTC m=+1204.558764085" watchObservedRunningTime="2026-09-15 21:28:30.157052722 +0000 UTC m=+1204.561374769"
Sep 15 21:28:30.172550 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:30.172501    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" podStartSLOduration=2.172488162 podStartE2EDuration="2.172488162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:30.170575625 +0000 UTC m=+1204.574897670" watchObservedRunningTime="2026-09-15 21:28:30.172488162 +0000 UTC m=+1204.576810207"
Sep 15 21:28:41.148994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:41.148961    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:28:41.149472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:41.149042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:28:44.962233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:44.962192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:28:50.974544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:50.974504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:52.539606 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:52.539561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:52.640871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:52.640834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:53.305303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:53.305263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:53.661814 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:53.661772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:54.104992 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:54.104956    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:54.338235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:54.338206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:54.438080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:54.437982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:54.788994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:54.788901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:54.989034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:54.988997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:55.293471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.293387    2560 generic.go:356] "Generic (PLEG): container finished" podID="523f60d5-a70e-4126-871b-e10ab191543d" containerID="95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256" exitCode=0
Sep 15 21:28:55.293664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.293463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerDied","Data":"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"}
Sep 15 21:28:55.293920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.293904    2560 scope.go:117] "RemoveContainer" containerID="95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"
Sep 15 21:28:55.295096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.295064    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:55.295171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.295136    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:55.295209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.295186    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:55.745979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:55.745858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:56.301699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:56.301661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerStarted","Data":"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"}
Sep 15 21:28:56.847291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:56.847254    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:57.119553 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:57.119507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:28:57.120008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:57.119978    2560 patch_prober.go:28] interesting pod/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 15 21:28:57.120111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:57.120055    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 15 21:28:58.119242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:58.119195    2560 patch_prober.go:28] interesting pod/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 15 21:28:58.119745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:58.119267    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 15 21:28:59.119740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:59.119694    2560 patch_prober.go:28] interesting pod/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 15 21:28:59.120267 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:28:59.119772    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 15 21:29:00.119151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:00.119104    2560 patch_prober.go:28] interesting pod/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 15 21:29:00.119369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:00.119178    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 15 21:29:01.119837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.119790    2560 patch_prober.go:28] interesting pod/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 15 21:29:01.120308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.119869    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 15 21:29:01.413511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.413414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:01.511222 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.511186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:01.767381 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.767296    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"]
Sep 15 21:29:01.770204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.770187    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:01.773086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.773066    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:29:01.780119 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.780092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"]
Sep 15 21:29:01.848648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.848606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b\" (UID: \"ce2565e9-3908-4903-befa-7e49d859d764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:01.949805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.949760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b\" (UID: \"ce2565e9-3908-4903-befa-7e49d859d764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:01.950411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:01.950392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b\" (UID: \"ce2565e9-3908-4903-befa-7e49d859d764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:02.082069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.081989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:02.124417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.124386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:29:02.124920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.124639    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:29:02.125504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.125483    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:29:02.356632 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.356606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"]
Sep 15 21:29:02.357910 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:29:02.357884    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2565e9_3908_4903_befa_7e49d859d764.slice/crio-8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d WatchSource:0}: Error finding container 8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d: Status 404 returned error can't find the container with id 8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d
Sep 15 21:29:02.897588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:02.897470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:03.355379 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:03.355348    2560 generic.go:356] "Generic (PLEG): container finished" podID="ce2565e9-3908-4903-befa-7e49d859d764" containerID="5948a649933b6b04ef5725152cac3680f0fc174d7181180c29e434fbf02d0fe3" exitCode=0
Sep 15 21:29:03.355774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:03.355436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b" event={"ID":"ce2565e9-3908-4903-befa-7e49d859d764","Type":"ContainerDied","Data":"5948a649933b6b04ef5725152cac3680f0fc174d7181180c29e434fbf02d0fe3"}
Sep 15 21:29:03.355774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:03.355501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b" event={"ID":"ce2565e9-3908-4903-befa-7e49d859d764","Type":"ContainerStarted","Data":"8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d"}
Sep 15 21:29:03.649798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:03.649678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:04.378229 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:04.378193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:04.499743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:04.499718    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:04.575297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:04.575264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca\") pod \"ce2565e9-3908-4903-befa-7e49d859d764\" (UID: \"ce2565e9-3908-4903-befa-7e49d859d764\") "
Sep 15 21:29:04.575634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:04.575610    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce2565e9-3908-4903-befa-7e49d859d764" (UID: "ce2565e9-3908-4903-befa-7e49d859d764"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:04.677180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:04.677091    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce2565e9-3908-4903-befa-7e49d859d764-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:05.200182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:05.200133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:05.370341 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:05.370311    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"
Sep 15 21:29:05.370508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:05.370348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b" event={"ID":"ce2565e9-3908-4903-befa-7e49d859d764","Type":"ContainerDied","Data":"8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d"}
Sep 15 21:29:05.370508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:05.370396    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8703d9b935ff9cc2348b6671e38d00c9be3980819d1d633bd08aafa0d117139d"
Sep 15 21:29:05.891803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:05.891767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.622399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:06.622366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:07.447449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:07.447406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:11.247086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.247053    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:29:11.247503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.247489    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2565e9-3908-4903-befa-7e49d859d764" containerName="revoke-keys"
Sep 15 21:29:11.247551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.247505    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2565e9-3908-4903-befa-7e49d859d764" containerName="revoke-keys"
Sep 15 21:29:11.247602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.247593    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce2565e9-3908-4903-befa-7e49d859d764" containerName="revoke-keys"
Sep 15 21:29:11.250912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.250893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.254262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.254241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"e2e-conflict-a-23fd2eb6-kserve-self-signed-certs\""
Sep 15 21:29:11.262496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.262475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:29:11.282635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.282606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:11.349597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.349782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.349782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.349782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxgr6\" (UniqueName: \"kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.349782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.349782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.349756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450769 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxgr6\" (UniqueName: \"kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.450920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.450883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.451342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.451314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.451421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.451340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.451421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.451386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.453246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.453226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.453486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.453471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.459803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.459781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxgr6\" (UniqueName: \"kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6\") pod \"e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") " pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.561095 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.560997    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:11.840919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:11.840883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:29:12.306761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.306726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.343361 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.343326    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:29:12.343580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.343552    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" podUID="55f3f6b9-3404-4032-8553-7c0e26425145" containerName="payload-processing" containerID="cri-o://413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f" gracePeriod=30
Sep 15 21:29:12.348648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.348599    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:29:12.349414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.348895    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" podUID="c8ce3750-6b63-4458-8191-5ec173a36bba" containerName="payload-pre-processing" containerID="cri-o://b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf" gracePeriod=30
Sep 15 21:29:12.393738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.393704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.418312 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.418271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" event={"ID":"b918c8dd-a91f-493a-a09b-e170c2047b1b","Type":"ContainerStarted","Data":"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"}
Sep 15 21:29:12.418493 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.418321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" event={"ID":"b918c8dd-a91f-493a-a09b-e170c2047b1b","Type":"ContainerStarted","Data":"0bdc53a38b8ecc662a04f2b29df7304c72df5e37edc41a5edaa20b2c1077c5a4"}
Sep 15 21:29:12.446660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.446596    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" podStartSLOduration=1.446579782 podStartE2EDuration="1.446579782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:12.443897391 +0000 UTC m=+1246.848219437" watchObservedRunningTime="2026-09-15 21:29:12.446579782 +0000 UTC m=+1246.850901825"
Sep 15 21:29:12.490282 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.490249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.561456 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.561352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.563273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.563249    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"]
Sep 15 21:29:12.567626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.567599    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11b5978b-gsj7b"]
Sep 15 21:29:12.616613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.616587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.633786 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.633762    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:29:12.636319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.636299    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:29:12.662209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.662183    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswqf\" (UniqueName: \"kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf\") pod \"c8ce3750-6b63-4458-8191-5ec173a36bba\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") "
Sep 15 21:29:12.662341 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.662230    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume\") pod \"c8ce3750-6b63-4458-8191-5ec173a36bba\" (UID: \"c8ce3750-6b63-4458-8191-5ec173a36bba\") "
Sep 15 21:29:12.662341 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.662255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume\") pod \"55f3f6b9-3404-4032-8553-7c0e26425145\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") "
Sep 15 21:29:12.662593 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.662571    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55f3f6b9-3404-4032-8553-7c0e26425145" (UID: "55f3f6b9-3404-4032-8553-7c0e26425145"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:12.662661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.662642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8ce3750-6b63-4458-8191-5ec173a36bba" (UID: "c8ce3750-6b63-4458-8191-5ec173a36bba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:12.664411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.664389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf" (OuterVolumeSpecName: "kube-api-access-wswqf") pod "c8ce3750-6b63-4458-8191-5ec173a36bba" (UID: "c8ce3750-6b63-4458-8191-5ec173a36bba"). InnerVolumeSpecName "kube-api-access-wswqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:12.763326 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.763295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drpjn\" (UniqueName: \"kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn\") pod \"55f3f6b9-3404-4032-8553-7c0e26425145\" (UID: \"55f3f6b9-3404-4032-8553-7c0e26425145\") "
Sep 15 21:29:12.763522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.763511    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswqf\" (UniqueName: \"kubernetes.io/projected/c8ce3750-6b63-4458-8191-5ec173a36bba-kube-api-access-wswqf\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:12.763579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.763524    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ce3750-6b63-4458-8191-5ec173a36bba-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:12.763579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.763534    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55f3f6b9-3404-4032-8553-7c0e26425145-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:12.765500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.765474    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn" (OuterVolumeSpecName: "kube-api-access-drpjn") pod "55f3f6b9-3404-4032-8553-7c0e26425145" (UID: "55f3f6b9-3404-4032-8553-7c0e26425145"). InnerVolumeSpecName "kube-api-access-drpjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:12.864144 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.864109    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drpjn\" (UniqueName: \"kubernetes.io/projected/55f3f6b9-3404-4032-8553-7c0e26425145-kube-api-access-drpjn\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:12.913319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:12.913285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.008079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.008038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.426001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.425969    2560 generic.go:356] "Generic (PLEG): container finished" podID="55f3f6b9-3404-4032-8553-7c0e26425145" containerID="413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f" exitCode=0
Sep 15 21:29:13.426449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.426007    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"
Sep 15 21:29:13.426449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.426046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" event={"ID":"55f3f6b9-3404-4032-8553-7c0e26425145","Type":"ContainerDied","Data":"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"}
Sep 15 21:29:13.426449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.426100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj" event={"ID":"55f3f6b9-3404-4032-8553-7c0e26425145","Type":"ContainerDied","Data":"d60d1e2222264a6c7db37c21b039cb66775814e0bc26dd39816ec7c9a35282d1"}
Sep 15 21:29:13.426449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.426126    2560 scope.go:117] "RemoveContainer" containerID="413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"
Sep 15 21:29:13.427535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.427511    2560 generic.go:356] "Generic (PLEG): container finished" podID="c8ce3750-6b63-4458-8191-5ec173a36bba" containerID="b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf" exitCode=0
Sep 15 21:29:13.427640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.427550    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"
Sep 15 21:29:13.427640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.427586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" event={"ID":"c8ce3750-6b63-4458-8191-5ec173a36bba","Type":"ContainerDied","Data":"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"}
Sep 15 21:29:13.427640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.427636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw" event={"ID":"c8ce3750-6b63-4458-8191-5ec173a36bba","Type":"ContainerDied","Data":"0886f1f5a0c9d78f8ad3d8432f3fb571be67d0298ff32f100e42f61574d2b7ec"}
Sep 15 21:29:13.437117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.437097    2560 scope.go:117] "RemoveContainer" containerID="413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"
Sep 15 21:29:13.437414 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:13.437395    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f\": container with ID starting with 413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f not found: ID does not exist" containerID="413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"
Sep 15 21:29:13.437477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.437423    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f"} err="failed to get container status \"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f\": rpc error: code = NotFound desc = could not find container \"413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f\": container with ID starting with 413e32d4a3c72043a42675f707a4cb93f4388e23f390cd3f85578b28bb70475f not found: ID does not exist"
Sep 15 21:29:13.437477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.437444    2560 scope.go:117] "RemoveContainer" containerID="b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"
Sep 15 21:29:13.446474 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.446458    2560 scope.go:117] "RemoveContainer" containerID="b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"
Sep 15 21:29:13.446730 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:13.446712    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf\": container with ID starting with b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf not found: ID does not exist" containerID="b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"
Sep 15 21:29:13.446776 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.446738    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf"} err="failed to get container status \"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf\": rpc error: code = NotFound desc = could not find container \"b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf\": container with ID starting with b0f467b6a895b463b36bd003ea4ecf522d083355a6eff81d535e9b709b727ccf not found: ID does not exist"
Sep 15 21:29:13.453737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.453715    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:29:13.459566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.459545    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11b5978b-65959465bf-5dxwj"]
Sep 15 21:29:13.470646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.470623    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:29:13.473852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.473831    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11b5978b-7589b955d6-bwsxw"]
Sep 15 21:29:13.788305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:13.788216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:14.083573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:14.083488    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f3f6b9-3404-4032-8553-7c0e26425145" path="/var/lib/kubelet/pods/55f3f6b9-3404-4032-8553-7c0e26425145/volumes"
Sep 15 21:29:14.083858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:14.083845    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ce3750-6b63-4458-8191-5ec173a36bba" path="/var/lib/kubelet/pods/c8ce3750-6b63-4458-8191-5ec173a36bba/volumes"
Sep 15 21:29:14.084167 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:14.084154    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2565e9-3908-4903-befa-7e49d859d764" path="/var/lib/kubelet/pods/ce2565e9-3908-4903-befa-7e49d859d764/volumes"
Sep 15 21:29:14.492331 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:14.492270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:15.408616 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:15.408583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:16.297682 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:16.297629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:17.092335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:17.092294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:18.063767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:18.063664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:29:19.589239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:19.589203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:19.686500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:19.686467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:19.838909 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:19.838868    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:29:19.839176 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:19.839119    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy" containerID="cri-o://f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e" gracePeriod=30
Sep 15 21:29:19.864207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:19.864171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:20.176837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:20.176800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:20.276755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:20.276704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:20.399543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:20.399497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:21.561534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:21.561499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:21.561976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:21.561546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:21.573964 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:21.573927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:22.495442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:22.495408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:29:24.778702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:24.778661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:25.090170 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.090145    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:29:25.188535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188548    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188597    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188662    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188684    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.188760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188752    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.189111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188788    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.189111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.188854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc7p7\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7\") pod \"523f60d5-a70e-4126-871b-e10ab191543d\" (UID: \"523f60d5-a70e-4126-871b-e10ab191543d\") "
Sep 15 21:29:25.189111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data" (OuterVolumeSpecName: "istio-data") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:25.189111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:25.189111 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:25.189371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:25.189432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189413    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:25.189534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189509    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189537    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189553    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189566    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/523f60d5-a70e-4126-871b-e10ab191543d-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.189579    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.190969 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.190916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:29:25.191229 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.191207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7" (OuterVolumeSpecName: "kube-api-access-kc7p7") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "kube-api-access-kc7p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:25.191299 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.191216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token" (OuterVolumeSpecName: "istio-token") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:25.191299 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.191222    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "523f60d5-a70e-4126-871b-e10ab191543d" (UID: "523f60d5-a70e-4126-871b-e10ab191543d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:25.291056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.291011    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.291056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.291048    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/523f60d5-a70e-4126-871b-e10ab191543d-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.291056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.291061    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc7p7\" (UniqueName: \"kubernetes.io/projected/523f60d5-a70e-4126-871b-e10ab191543d-kube-api-access-kc7p7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.291292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.291075    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/523f60d5-a70e-4126-871b-e10ab191543d-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:25.506312 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.506275    2560 generic.go:356] "Generic (PLEG): container finished" podID="523f60d5-a70e-4126-871b-e10ab191543d" containerID="f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e" exitCode=0
Sep 15 21:29:25.506510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.506324    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"
Sep 15 21:29:25.506510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.506354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerDied","Data":"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"}
Sep 15 21:29:25.506510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.506417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p" event={"ID":"523f60d5-a70e-4126-871b-e10ab191543d","Type":"ContainerDied","Data":"f866945721697c5e947e85e43fabfebc6826a17ae3417bd89f4ddd7e7992db9b"}
Sep 15 21:29:25.506510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.506448    2560 scope.go:117] "RemoveContainer" containerID="f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"
Sep 15 21:29:25.516296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.516278    2560 scope.go:117] "RemoveContainer" containerID="95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"
Sep 15 21:29:25.524700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.524675    2560 scope.go:117] "RemoveContainer" containerID="f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"
Sep 15 21:29:25.524981 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:25.524962    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e\": container with ID starting with f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e not found: ID does not exist" containerID="f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"
Sep 15 21:29:25.525069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.524994    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e"} err="failed to get container status \"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e\": rpc error: code = NotFound desc = could not find container \"f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e\": container with ID starting with f261b74ffd228f12e07959db8a0adf9c555d7e6582d7643702306f5110197f9e not found: ID does not exist"
Sep 15 21:29:25.525069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.525018    2560 scope.go:117] "RemoveContainer" containerID="95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"
Sep 15 21:29:25.525292 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:25.525274    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256\": container with ID starting with 95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256 not found: ID does not exist" containerID="95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"
Sep 15 21:29:25.525336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.525298    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256"} err="failed to get container status \"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256\": rpc error: code = NotFound desc = could not find container \"95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256\": container with ID starting with 95fd320a58dfa113a8e151829381ba0b159330ed0e00d393c3627e3a858e2256 not found: ID does not exist"
Sep 15 21:29:25.529686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.529662    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:29:25.534027 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.534007    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-11b5978b-openshift-default-6f6646fd48-mjw8p"]
Sep 15 21:29:25.598118 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:25.598082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.083604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:26.083573    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="523f60d5-a70e-4126-871b-e10ab191543d" path="/var/lib/kubelet/pods/523f60d5-a70e-4126-871b-e10ab191543d/volumes"
Sep 15 21:29:26.765863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:26.765829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.878299 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:26.878271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.967785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:26.967741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:27.111098 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:27.111062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:27.887998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:27.887927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:28.764702 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:28.764658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:30.639741 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.639700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:30.735958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.735914    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"]
Sep 15 21:29:30.736333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736320    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736334    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736347    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736353    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736366    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f3f6b9-3404-4032-8553-7c0e26425145" containerName="payload-processing"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736372    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f3f6b9-3404-4032-8553-7c0e26425145" containerName="payload-processing"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736381    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ce3750-6b63-4458-8191-5ec173a36bba" containerName="payload-pre-processing"
Sep 15 21:29:30.736392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736386    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ce3750-6b63-4458-8191-5ec173a36bba" containerName="payload-pre-processing"
Sep 15 21:29:30.736662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736453    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f3f6b9-3404-4032-8553-7c0e26425145" containerName="payload-processing"
Sep 15 21:29:30.736662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736465    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736476    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="523f60d5-a70e-4126-871b-e10ab191543d" containerName="istio-proxy"
Sep 15 21:29:30.736662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.736486    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ce3750-6b63-4458-8191-5ec173a36bba" containerName="payload-pre-processing"
Sep 15 21:29:30.739700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.739683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:30.743511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.743489    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:29:30.748931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.748908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"]
Sep 15 21:29:30.849604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.849559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-928184-bxvft\" (UID: \"9a902a9f-a374-4ad0-9a65-12e94b0fee0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:30.935642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.935554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:30.950847 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.950814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-928184-bxvft\" (UID: \"9a902a9f-a374-4ad0-9a65-12e94b0fee0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:30.951518 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:30.951496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-928184-bxvft\" (UID: \"9a902a9f-a374-4ad0-9a65-12e94b0fee0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:31.051949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:31.051906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:31.329335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:31.329311    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"]
Sep 15 21:29:31.330449 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:29:31.330425    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a902a9f_a374_4ad0_9a65_12e94b0fee0d.slice/crio-a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b WatchSource:0}: Error finding container a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b: Status 404 returned error can't find the container with id a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b
Sep 15 21:29:31.548085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:31.548054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft" event={"ID":"9a902a9f-a374-4ad0-9a65-12e94b0fee0d","Type":"ContainerStarted","Data":"a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b"}
Sep 15 21:29:31.889271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:31.889183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:32.555622 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:32.555584    2560 generic.go:356] "Generic (PLEG): container finished" podID="9a902a9f-a374-4ad0-9a65-12e94b0fee0d" containerID="9dfd289a7fee428f591cbceac6d7b71d6d9bd56f01ab7c2d09ddc0ad01e4410a" exitCode=0
Sep 15 21:29:32.555814 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:32.555672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft" event={"ID":"9a902a9f-a374-4ad0-9a65-12e94b0fee0d","Type":"ContainerDied","Data":"9dfd289a7fee428f591cbceac6d7b71d6d9bd56f01ab7c2d09ddc0ad01e4410a"}
Sep 15 21:29:32.825452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:32.825368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:33.704327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:33.704301    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:33.710674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:33.710650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:33.781768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:33.781732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca\") pod \"9a902a9f-a374-4ad0-9a65-12e94b0fee0d\" (UID: \"9a902a9f-a374-4ad0-9a65-12e94b0fee0d\") "
Sep 15 21:29:33.782123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:33.782100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9a902a9f-a374-4ad0-9a65-12e94b0fee0d" (UID: "9a902a9f-a374-4ad0-9a65-12e94b0fee0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:33.883132 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:33.883099    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a902a9f-a374-4ad0-9a65-12e94b0fee0d-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:34.568252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:34.568222    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"
Sep 15 21:29:34.568425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:34.568259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft" event={"ID":"9a902a9f-a374-4ad0-9a65-12e94b0fee0d","Type":"ContainerDied","Data":"a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b"}
Sep 15 21:29:34.568425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:34.568307    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4eeb1d2370f94d90e26f5227b4c2c7271653ac202c2a33c0aa4c3094ef7de1b"
Sep 15 21:29:35.314262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:35.314228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.415548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:35.415510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:36.430047 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:36.430010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:36.503157 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:36.503122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:38.297465 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:38.297430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:38.535475 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:38.535430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:38.958116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:38.958059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:39.668071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:39.668036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:40.700825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:40.700775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:41.492646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:41.492613    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:42.195438 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:42.195403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.235689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.235653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.343035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.342997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.435444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.435411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.746719 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.746667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.844148 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.844112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:43.874666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.874627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:29:43.875218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.875196    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a902a9f-a374-4ad0-9a65-12e94b0fee0d" containerName="revoke-keys"
Sep 15 21:29:43.875218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.875218    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a902a9f-a374-4ad0-9a65-12e94b0fee0d" containerName="revoke-keys"
Sep 15 21:29:43.875396 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.875363    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a902a9f-a374-4ad0-9a65-12e94b0fee0d" containerName="revoke-keys"
Sep 15 21:29:43.878882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.878861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:43.881798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.881773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-a3aa55-dockercfg-qjhsh\""
Sep 15 21:29:43.881928 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.881775    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-a3aa55\""
Sep 15 21:29:43.893200 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.893169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:29:43.895850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.895823    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:29:43.900243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.900220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:43.914977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.914918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:29:43.991953 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.991911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlf4s\" (UniqueName: \"kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:43.992122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:43.991963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.084415 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.084330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:44.093671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.093635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.093824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.093724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmcgl\" (UniqueName: \"kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.093824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.093757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlf4s\" (UniqueName: \"kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.093966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.093872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.094658 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.094636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.104652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.104625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlf4s\" (UniqueName: \"kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s\") pod \"payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.114978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.114922    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:29:44.115216 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.115187    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" podUID="c3f3a506-27b1-462d-93f7-bcdedc43f712" containerName="payload-processing" containerID="cri-o://36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f" gracePeriod=30
Sep 15 21:29:44.124084 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.124050    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:29:44.124314 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.124290    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" podUID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" containerName="payload-pre-processing" containerID="cri-o://1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7" gracePeriod=30
Sep 15 21:29:44.185067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.185029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:44.189924 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.189894    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.194588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.194558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmcgl\" (UniqueName: \"kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.194724 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.194655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.195628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.195605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.204046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.203999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmcgl\" (UniqueName: \"kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl\") pod \"payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.210777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.210750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.290100 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.289435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:44.347273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.347240    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"]
Sep 15 21:29:44.355321 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.355289    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-928184-bxvft"]
Sep 15 21:29:44.439868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.439841    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:29:44.451286 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.451261    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:29:44.485207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.484840    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:29:44.497001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.496962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtlwz\" (UniqueName: \"kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz\") pod \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") "
Sep 15 21:29:44.497260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.497233    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flr42\" (UniqueName: \"kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42\") pod \"c3f3a506-27b1-462d-93f7-bcdedc43f712\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") "
Sep 15 21:29:44.497541 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.497518    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume\") pod \"c3f3a506-27b1-462d-93f7-bcdedc43f712\" (UID: \"c3f3a506-27b1-462d-93f7-bcdedc43f712\") "
Sep 15 21:29:44.497736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.497715    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume\") pod \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\" (UID: \"b3a28ab0-16a1-48b2-8b78-9185db588ba6\") "
Sep 15 21:29:44.498037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.497890    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3f3a506-27b1-462d-93f7-bcdedc43f712" (UID: "c3f3a506-27b1-462d-93f7-bcdedc43f712"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:44.498192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.498163    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3a28ab0-16a1-48b2-8b78-9185db588ba6" (UID: "b3a28ab0-16a1-48b2-8b78-9185db588ba6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:44.498323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.498218    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f3a506-27b1-462d-93f7-bcdedc43f712-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:44.499837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.499812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42" (OuterVolumeSpecName: "kube-api-access-flr42") pod "c3f3a506-27b1-462d-93f7-bcdedc43f712" (UID: "c3f3a506-27b1-462d-93f7-bcdedc43f712"). InnerVolumeSpecName "kube-api-access-flr42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:44.499970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.499891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz" (OuterVolumeSpecName: "kube-api-access-xtlwz") pod "b3a28ab0-16a1-48b2-8b78-9185db588ba6" (UID: "b3a28ab0-16a1-48b2-8b78-9185db588ba6"). InnerVolumeSpecName "kube-api-access-xtlwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:44.513507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.513477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:29:44.516285 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:29:44.516253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3096012_9aaf_4c38_add4_5476bacace70.slice/crio-6258d83eab3d6e75c7d54ff4dccc4b22d0217f1d97e312f0b6f7603791fa9eab WatchSource:0}: Error finding container 6258d83eab3d6e75c7d54ff4dccc4b22d0217f1d97e312f0b6f7603791fa9eab: Status 404 returned error can't find the container with id 6258d83eab3d6e75c7d54ff4dccc4b22d0217f1d97e312f0b6f7603791fa9eab
Sep 15 21:29:44.599407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.599376    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flr42\" (UniqueName: \"kubernetes.io/projected/c3f3a506-27b1-462d-93f7-bcdedc43f712-kube-api-access-flr42\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:44.599407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.599409    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a28ab0-16a1-48b2-8b78-9185db588ba6-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:44.599585 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.599418    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtlwz\" (UniqueName: \"kubernetes.io/projected/b3a28ab0-16a1-48b2-8b78-9185db588ba6-kube-api-access-xtlwz\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:29:44.633558 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.633506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" event={"ID":"323d19d1-471f-4607-8c1f-eac8084c2121","Type":"ContainerStarted","Data":"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"}
Sep 15 21:29:44.633759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.633582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:44.633759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.633606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" event={"ID":"323d19d1-471f-4607-8c1f-eac8084c2121","Type":"ContainerStarted","Data":"33ce487c91e26573b64c2ed9ab86a61bb01a14f4975cb1e1c9ee51d99e8c0fbb"}
Sep 15 21:29:44.635199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.635172    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3f3a506-27b1-462d-93f7-bcdedc43f712" containerID="36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f" exitCode=0
Sep 15 21:29:44.635339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.635223    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"
Sep 15 21:29:44.635339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.635249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" event={"ID":"c3f3a506-27b1-462d-93f7-bcdedc43f712","Type":"ContainerDied","Data":"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"}
Sep 15 21:29:44.635339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.635296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d" event={"ID":"c3f3a506-27b1-462d-93f7-bcdedc43f712","Type":"ContainerDied","Data":"6612b1965f9978d55e79879b02540b412298e367da225ba3ba74f4ad5b3ad693"}
Sep 15 21:29:44.635339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.635310    2560 scope.go:117] "RemoveContainer" containerID="36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"
Sep 15 21:29:44.636862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.636835    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" containerID="1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7" exitCode=0
Sep 15 21:29:44.636979 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.636906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" event={"ID":"b3a28ab0-16a1-48b2-8b78-9185db588ba6","Type":"ContainerDied","Data":"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"}
Sep 15 21:29:44.637039 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.636993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp" event={"ID":"b3a28ab0-16a1-48b2-8b78-9185db588ba6","Type":"ContainerDied","Data":"5699bedc393b8836f679e5e03808b30ccaa19ff70a33b6ce85496f485c3db27e"}
Sep 15 21:29:44.637187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.637166    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"
Sep 15 21:29:44.638960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.638915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" event={"ID":"e3096012-9aaf-4c38-add4-5476bacace70","Type":"ContainerStarted","Data":"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"}
Sep 15 21:29:44.639058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.638977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" event={"ID":"e3096012-9aaf-4c38-add4-5476bacace70","Type":"ContainerStarted","Data":"6258d83eab3d6e75c7d54ff4dccc4b22d0217f1d97e312f0b6f7603791fa9eab"}
Sep 15 21:29:44.639058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.639023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:29:44.648579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.648500    2560 scope.go:117] "RemoveContainer" containerID="36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"
Sep 15 21:29:44.649168 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:44.649138    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f\": container with ID starting with 36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f not found: ID does not exist" containerID="36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"
Sep 15 21:29:44.649273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.649176    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f"} err="failed to get container status \"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f\": rpc error: code = NotFound desc = could not find container \"36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f\": container with ID starting with 36680a27d24dd8b19939b49eedf8e085f142b6bf31e1322b65e7c12b1b6ac04f not found: ID does not exist"
Sep 15 21:29:44.649273 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.649200    2560 scope.go:117] "RemoveContainer" containerID="1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"
Sep 15 21:29:44.655405 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.655349    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" podStartSLOduration=1.655330126 podStartE2EDuration="1.655330126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:44.652549618 +0000 UTC m=+1279.056871666" watchObservedRunningTime="2026-09-15 21:29:44.655330126 +0000 UTC m=+1279.059652172"
Sep 15 21:29:44.660558 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.660534    2560 scope.go:117] "RemoveContainer" containerID="1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"
Sep 15 21:29:44.660908 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:29:44.660886    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7\": container with ID starting with 1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7 not found: ID does not exist" containerID="1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"
Sep 15 21:29:44.661041 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.660921    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7"} err="failed to get container status \"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7\": rpc error: code = NotFound desc = could not find container \"1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7\": container with ID starting with 1d63c5b403e4e578dabee19906b95e5f0d6b16ef835ef96637342c8fe556cec7 not found: ID does not exist"
Sep 15 21:29:44.668306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.668275    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:29:44.682960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.671815    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-928184-596f55f56f-krq5d"]
Sep 15 21:29:44.695424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.695382    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:29:44.697787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.697760    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-928184-8975558d6-9txtp"]
Sep 15 21:29:44.715084 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:44.715025    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" podStartSLOduration=1.715006427 podStartE2EDuration="1.715006427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:44.712564641 +0000 UTC m=+1279.116886689" watchObservedRunningTime="2026-09-15 21:29:44.715006427 +0000 UTC m=+1279.119328473"
Sep 15 21:29:45.622095 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:45.622062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:45.751519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:45.751487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:46.082295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:46.082194    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a902a9f-a374-4ad0-9a65-12e94b0fee0d" path="/var/lib/kubelet/pods/9a902a9f-a374-4ad0-9a65-12e94b0fee0d/volumes"
Sep 15 21:29:46.082590 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:46.082576    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" path="/var/lib/kubelet/pods/b3a28ab0-16a1-48b2-8b78-9185db588ba6/volumes"
Sep 15 21:29:46.082905 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:46.082893    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f3a506-27b1-462d-93f7-bcdedc43f712" path="/var/lib/kubelet/pods/c3f3a506-27b1-462d-93f7-bcdedc43f712/volumes"
Sep 15 21:29:46.170752 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:46.170716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:46.938787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:46.938751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:47.686159 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:47.686120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:48.527389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:48.527344    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:49.381787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:49.381745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:50.887104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:50.887060    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:50.986364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:50.986325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:51.143054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.142965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:51.566536 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.566436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:51.847795 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.847704    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:29:51.848214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848197    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" containerName="payload-pre-processing"
Sep 15 21:29:51.848316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848216    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" containerName="payload-pre-processing"
Sep 15 21:29:51.848316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848229    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f3a506-27b1-462d-93f7-bcdedc43f712" containerName="payload-processing"
Sep 15 21:29:51.848316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848237    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f3a506-27b1-462d-93f7-bcdedc43f712" containerName="payload-processing"
Sep 15 21:29:51.848466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848385    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a28ab0-16a1-48b2-8b78-9185db588ba6" containerName="payload-pre-processing"
Sep 15 21:29:51.848466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.848400    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f3a506-27b1-462d-93f7-bcdedc43f712" containerName="payload-processing"
Sep 15 21:29:51.853353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.853332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.856923 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.856905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 21:29:51.857223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.857207    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-d130a8-openshift-default-dockercfg-7lwdr\""
Sep 15 21:29:51.868304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.868278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:29:51.880143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.880113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:51.964618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfmz4\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:51.965088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:51.964866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfmz4\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.065902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.065715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.066091 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.066009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.066168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.066141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.066218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.066189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.066349 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.066311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.066501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.066483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.067798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.067779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.067947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.067920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.074455 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.074427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.074672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.074649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfmz4\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4\") pod \"e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") " pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.163879 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.163841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:52.254949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.254909    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:52.452789 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.452760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:29:52.454527 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:29:52.454500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f73fdf_5a20_42b5_b784_8f593741d281.slice/crio-47c73d75cd997da02371befb216cb9f611d6d0f69e287a9aa36c9c805c0fbdb4 WatchSource:0}: Error finding container 47c73d75cd997da02371befb216cb9f611d6d0f69e287a9aa36c9c805c0fbdb4: Status 404 returned error can't find the container with id 47c73d75cd997da02371befb216cb9f611d6d0f69e287a9aa36c9c805c0fbdb4
Sep 15 21:29:52.456644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.456614    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:52.456721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.456680    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:52.456721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.456715    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:52.692839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.692799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" event={"ID":"94f73fdf-5a20-42b5-b784-8f593741d281","Type":"ContainerStarted","Data":"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"}
Sep 15 21:29:52.693033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.692864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" event={"ID":"94f73fdf-5a20-42b5-b784-8f593741d281","Type":"ContainerStarted","Data":"47c73d75cd997da02371befb216cb9f611d6d0f69e287a9aa36c9c805c0fbdb4"}
Sep 15 21:29:52.721510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:52.721392    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" podStartSLOduration=1.721369235 podStartE2EDuration="1.721369235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:52.71877233 +0000 UTC m=+1287.123094377" watchObservedRunningTime="2026-09-15 21:29:52.721369235 +0000 UTC m=+1287.125691284"
Sep 15 21:29:53.003096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.002997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:53.100335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.100305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:53.164896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.164858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:53.170559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.170532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:53.245919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.245887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:53.699685 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.699641    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:53.700537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:53.700518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:29:54.677354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:54.677320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:54.779432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:54.779395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:29:55.651122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:55.651091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:29:55.651322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:29:55.651171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:30:00.192613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.192577    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"]
Sep 15 21:30:00.196414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.196397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"
Sep 15 21:30:00.199849 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.199829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:30:00.206863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.206841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"
Sep 15 21:30:00.207772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.207751    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"]
Sep 15 21:30:00.211360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.211345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"
Sep 15 21:30:00.238050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.238019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"
Sep 15 21:30:00.239581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.239554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"]
Sep 15 21:30:00.261754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.261671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"]
Sep 15 21:30:00.293487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.293456    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"]
Sep 15 21:30:00.299007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.298984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"
Sep 15 21:30:00.311921 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.311646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"]
Sep 15 21:30:00.317875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.317750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"
Sep 15 21:30:00.488063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.488033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"]
Sep 15 21:30:00.489483 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:00.489459    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456003fc_4b31_4e31_98d6_2b4906c2f1c1.slice/crio-20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116 WatchSource:0}: Error finding container 20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116: Status 404 returned error can't find the container with id 20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116
Sep 15 21:30:00.540171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.540145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"]
Sep 15 21:30:00.542238 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:00.542208    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e05558_e103_4b29_9e39_b2ab0c143bad.slice/crio-56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc WatchSource:0}: Error finding container 56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc: Status 404 returned error can't find the container with id 56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc
Sep 15 21:30:00.602139 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.602112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"]
Sep 15 21:30:00.604165 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:00.604136    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6826b52b_fa9f_46d0_88a2_12b24a924f91.slice/crio-a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9 WatchSource:0}: Error finding container a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9: Status 404 returned error can't find the container with id a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9
Sep 15 21:30:00.748252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.748168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6" event={"ID":"45e05558-e103-4b29-9e39-b2ab0c143bad","Type":"ContainerStarted","Data":"56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc"}
Sep 15 21:30:00.749359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.749335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv" event={"ID":"6826b52b-fa9f-46d0-88a2-12b24a924f91","Type":"ContainerStarted","Data":"a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9"}
Sep 15 21:30:00.750535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:00.750511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx" event={"ID":"456003fc-4b31-4e31-98d6-2b4906c2f1c1","Type":"ContainerStarted","Data":"20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116"}
Sep 15 21:30:01.758696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.758597    2560 generic.go:356] "Generic (PLEG): container finished" podID="6826b52b-fa9f-46d0-88a2-12b24a924f91" containerID="24015a6aa382adf7faa35cdfd528b36dd8bc1776ee5373408bb91c909b7ed2f3" exitCode=0
Sep 15 21:30:01.758696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.758677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv" event={"ID":"6826b52b-fa9f-46d0-88a2-12b24a924f91","Type":"ContainerDied","Data":"24015a6aa382adf7faa35cdfd528b36dd8bc1776ee5373408bb91c909b7ed2f3"}
Sep 15 21:30:01.760258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.760238    2560 generic.go:356] "Generic (PLEG): container finished" podID="456003fc-4b31-4e31-98d6-2b4906c2f1c1" containerID="d2282d712e3d2b8e4200c4a5059797ce34873b5033b94f7f8e36e78277f3c7e9" exitCode=0
Sep 15 21:30:01.760339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.760317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx" event={"ID":"456003fc-4b31-4e31-98d6-2b4906c2f1c1","Type":"ContainerDied","Data":"d2282d712e3d2b8e4200c4a5059797ce34873b5033b94f7f8e36e78277f3c7e9"}
Sep 15 21:30:01.761864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.761837    2560 generic.go:356] "Generic (PLEG): container finished" podID="45e05558-e103-4b29-9e39-b2ab0c143bad" containerID="4d245da394f59492ed8942ed7d5b0825570aaf061af64857dacc8f63daa80d24" exitCode=0
Sep 15 21:30:01.761985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:01.761870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6" event={"ID":"45e05558-e103-4b29-9e39-b2ab0c143bad","Type":"ContainerDied","Data":"4d245da394f59492ed8942ed7d5b0825570aaf061af64857dacc8f63daa80d24"}
Sep 15 21:30:02.935322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:02.935284    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"
Sep 15 21:30:02.937215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:02.937189    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"
Sep 15 21:30:02.978088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:02.978063    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"
Sep 15 21:30:03.775792 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.775763    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"
Sep 15 21:30:03.775792 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.775779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6" event={"ID":"45e05558-e103-4b29-9e39-b2ab0c143bad","Type":"ContainerDied","Data":"56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc"}
Sep 15 21:30:03.776050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.775823    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56cb229a832d410adfd60b32ccf89ccca9bbd3b3485d6bedc5186f8fb92534bc"
Sep 15 21:30:03.777388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.777360    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"
Sep 15 21:30:03.777388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.777372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv" event={"ID":"6826b52b-fa9f-46d0-88a2-12b24a924f91","Type":"ContainerDied","Data":"a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9"}
Sep 15 21:30:03.777571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.777409    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9ce348df23da613bbf74c6adf6ec5f52a914ae64cf8deb25f902a6693f5ebf9"
Sep 15 21:30:03.779056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.779037    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"
Sep 15 21:30:03.779172 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.779050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx" event={"ID":"456003fc-4b31-4e31-98d6-2b4906c2f1c1","Type":"ContainerDied","Data":"20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116"}
Sep 15 21:30:03.779172 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:03.779106    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20d6b42fcf5d6f1cc8193fbd75b68f19eeb2dc07cfb53ac2163e3bb122cd8116"
Sep 15 21:30:04.181916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:04.181880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:06.014513 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:06.014473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:06.994693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:06.994660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:07.997762 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:07.997717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:08.510561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:08.510523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:08.836417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:08.836322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:08.940189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:08.940149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:09.159534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:09.159505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:09.615212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:09.615185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:09.794959 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:09.794890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.831535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:10.831506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:12.624309 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:12.624274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:12.780824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:12.780785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:12.947833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:12.947736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:13.710539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:13.710500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:14.556070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:14.556036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:15.492130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:15.492093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:16.220649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:16.220609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:16.580254 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:16.580150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:16.678829 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:16.678782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:16.906365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:16.906335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:17.011375 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.011342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:17.254644 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.254555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:17.568682 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.568581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:17.667149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.667108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:17.676308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676281    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:30:17.676716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676695    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6826b52b-fa9f-46d0-88a2-12b24a924f91" containerName="cleanup"
Sep 15 21:30:17.676780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676719    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6826b52b-fa9f-46d0-88a2-12b24a924f91" containerName="cleanup"
Sep 15 21:30:17.676780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676730    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e05558-e103-4b29-9e39-b2ab0c143bad" containerName="cleanup"
Sep 15 21:30:17.676780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676753    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e05558-e103-4b29-9e39-b2ab0c143bad" containerName="cleanup"
Sep 15 21:30:17.676780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676767    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="456003fc-4b31-4e31-98d6-2b4906c2f1c1" containerName="cleanup"
Sep 15 21:30:17.676780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676772    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="456003fc-4b31-4e31-98d6-2b4906c2f1c1" containerName="cleanup"
Sep 15 21:30:17.676960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676847    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="456003fc-4b31-4e31-98d6-2b4906c2f1c1" containerName="cleanup"
Sep 15 21:30:17.676960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676855    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e05558-e103-4b29-9e39-b2ab0c143bad" containerName="cleanup"
Sep 15 21:30:17.676960 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.676863    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6826b52b-fa9f-46d0-88a2-12b24a924f91" containerName="cleanup"
Sep 15 21:30:17.681197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.681181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.684565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.684542    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-9aeead\""
Sep 15 21:30:17.692888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.692863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:30:17.704020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.703985    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:30:17.707929 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.707908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.711184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.711166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-9aeead-dockercfg-xzlcd\""
Sep 15 21:30:17.720894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.720868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:30:17.816886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.816847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.817067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.816913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.817067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.817031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6bkp\" (UniqueName: \"kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.817067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.817057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw2mt\" (UniqueName: \"kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.918313 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.918270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6bkp\" (UniqueName: \"kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.918544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.918325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw2mt\" (UniqueName: \"kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.918544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.918397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.918544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.918440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.919230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.919203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.919325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.919251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.927570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.927547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw2mt\" (UniqueName: \"kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:17.927689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.927593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6bkp\" (UniqueName: \"kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp\") pod \"payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:17.960291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.960258    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:30:17.992856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:17.992818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:18.019753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.019724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:18.272169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.272143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:30:18.273686 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:18.273661    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ddfee4_1964_49ef_a870_b383d10722eb.slice/crio-4e1fcdd9c1ac3daa41e156d0dc94f5e23ec38398222fa4e4228f592e4435a724 WatchSource:0}: Error finding container 4e1fcdd9c1ac3daa41e156d0dc94f5e23ec38398222fa4e4228f592e4435a724: Status 404 returned error can't find the container with id 4e1fcdd9c1ac3daa41e156d0dc94f5e23ec38398222fa4e4228f592e4435a724
Sep 15 21:30:18.304875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.304850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:30:18.313127 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:18.313101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a547154_6dab_4d13_b0b8_0f61e964cdff.slice/crio-0ef2b2aa7e5b7464d4c28b7690b5ab112b52a6cd7b8bdfa8788770635c93d563 WatchSource:0}: Error finding container 0ef2b2aa7e5b7464d4c28b7690b5ab112b52a6cd7b8bdfa8788770635c93d563: Status 404 returned error can't find the container with id 0ef2b2aa7e5b7464d4c28b7690b5ab112b52a6cd7b8bdfa8788770635c93d563
Sep 15 21:30:18.875779 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.875730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" event={"ID":"1a547154-6dab-4d13-b0b8-0f61e964cdff","Type":"ContainerStarted","Data":"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"}
Sep 15 21:30:18.876289 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.875801    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:18.876289 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.875827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" event={"ID":"1a547154-6dab-4d13-b0b8-0f61e964cdff","Type":"ContainerStarted","Data":"0ef2b2aa7e5b7464d4c28b7690b5ab112b52a6cd7b8bdfa8788770635c93d563"}
Sep 15 21:30:18.877563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.877539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" event={"ID":"a8ddfee4-1964-49ef-a870-b383d10722eb","Type":"ContainerStarted","Data":"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"}
Sep 15 21:30:18.877678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.877585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" event={"ID":"a8ddfee4-1964-49ef-a870-b383d10722eb","Type":"ContainerStarted","Data":"4e1fcdd9c1ac3daa41e156d0dc94f5e23ec38398222fa4e4228f592e4435a724"}
Sep 15 21:30:18.877678 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.877612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:18.892667 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.892621    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" podStartSLOduration=1.89260783 podStartE2EDuration="1.89260783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:18.891673351 +0000 UTC m=+1313.295995396" watchObservedRunningTime="2026-09-15 21:30:18.89260783 +0000 UTC m=+1313.296929930"
Sep 15 21:30:18.912095 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:18.912051    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" podStartSLOduration=1.912037261 podStartE2EDuration="1.912037261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:18.908782499 +0000 UTC m=+1313.313104547" watchObservedRunningTime="2026-09-15 21:30:18.912037261 +0000 UTC m=+1313.316359307"
Sep 15 21:30:29.885998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:29.885930    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:30:29.886377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:29.886132    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:30:29.987460 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:29.987375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:37.662778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.662741    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"]
Sep 15 21:30:37.667704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.667685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:37.670698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.670671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:30:37.679141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.679113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"]
Sep 15 21:30:37.708962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.708908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-70880c-b55kx\" (UID: \"fc649cba-7308-47a8-81ce-82ce5ec30eb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:37.810051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.810020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-70880c-b55kx\" (UID: \"fc649cba-7308-47a8-81ce-82ce5ec30eb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:37.810616 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.810595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-70880c-b55kx\" (UID: \"fc649cba-7308-47a8-81ce-82ce5ec30eb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:37.922155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.922044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:37.980298 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:37.980265    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:38.258851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:38.258824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"]
Sep 15 21:30:38.261057 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:30:38.261028    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc649cba_7308_47a8_81ce_82ce5ec30eb5.slice/crio-867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e WatchSource:0}: Error finding container 867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e: Status 404 returned error can't find the container with id 867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e
Sep 15 21:30:38.808275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:38.808181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:39.004207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:39.004175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx" event={"ID":"fc649cba-7308-47a8-81ce-82ce5ec30eb5","Type":"ContainerStarted","Data":"94e46c8e3f414ba02e5855fbaa34ce9f836f395e0ab861d38b57172d20a3f424"}
Sep 15 21:30:39.004353 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:39.004233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx" event={"ID":"fc649cba-7308-47a8-81ce-82ce5ec30eb5","Type":"ContainerStarted","Data":"867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e"}
Sep 15 21:30:39.022761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:39.022713    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx" podStartSLOduration=2.022697583 podStartE2EDuration="2.022697583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:39.019600387 +0000 UTC m=+1333.423922436" watchObservedRunningTime="2026-09-15 21:30:39.022697583 +0000 UTC m=+1333.427019628"
Sep 15 21:30:39.675423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:39.675389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:40.012160 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:40.012074    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc649cba-7308-47a8-81ce-82ce5ec30eb5" containerID="94e46c8e3f414ba02e5855fbaa34ce9f836f395e0ab861d38b57172d20a3f424" exitCode=0
Sep 15 21:30:40.012498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:40.012160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx" event={"ID":"fc649cba-7308-47a8-81ce-82ce5ec30eb5","Type":"ContainerDied","Data":"94e46c8e3f414ba02e5855fbaa34ce9f836f395e0ab861d38b57172d20a3f424"}
Sep 15 21:30:40.596159 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:40.596127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:41.158566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:41.158541    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:41.247743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:41.247712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca\") pod \"fc649cba-7308-47a8-81ce-82ce5ec30eb5\" (UID: \"fc649cba-7308-47a8-81ce-82ce5ec30eb5\") "
Sep 15 21:30:41.248115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:41.248092    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc649cba-7308-47a8-81ce-82ce5ec30eb5" (UID: "fc649cba-7308-47a8-81ce-82ce5ec30eb5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:30:41.348801 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:41.348766    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc649cba-7308-47a8-81ce-82ce5ec30eb5-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:30:41.692275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:41.692194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:42.026922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:42.026831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx" event={"ID":"fc649cba-7308-47a8-81ce-82ce5ec30eb5","Type":"ContainerDied","Data":"867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e"}
Sep 15 21:30:42.026922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:42.026888    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="867a4e87514cf89d421797a850ca0f66ce9930b7f98c977fb066297460842e4e"
Sep 15 21:30:42.026922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:42.026847    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"
Sep 15 21:30:42.447706 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:42.447674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:42.742793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:42.742711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:43.317672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:43.317635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:44.098597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:44.098565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:44.817696 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:44.817662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:45.799260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:45.799227    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.001963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.001909    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.699115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.699081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.731439 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.731406    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:30:48.731629 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.731597    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" podUID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" containerName="payload-processing" containerID="cri-o://de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17" gracePeriod=30
Sep 15 21:30:48.774698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.774668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.876648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.876616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.911839 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.911805    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"]
Sep 15 21:30:48.916351 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.916322    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-70880c-b55kx"]
Sep 15 21:30:48.943262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.943224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:48.994250 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:48.994226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:30:49.071612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.071577    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" containerID="de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17" exitCode=0
Sep 15 21:30:49.072073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.071619    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"
Sep 15 21:30:49.072073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.071650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" event={"ID":"3f3e7e76-bbb8-4645-a3c6-3310864bd70f","Type":"ContainerDied","Data":"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"}
Sep 15 21:30:49.072073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.071712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq" event={"ID":"3f3e7e76-bbb8-4645-a3c6-3310864bd70f","Type":"ContainerDied","Data":"4e51f0dd53dd280048617397eb7bdc6a2c9c8f4ddbe04cbc8600bcf364fc2f30"}
Sep 15 21:30:49.072073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.071748    2560 scope.go:117] "RemoveContainer" containerID="de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"
Sep 15 21:30:49.083565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.083544    2560 scope.go:117] "RemoveContainer" containerID="de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"
Sep 15 21:30:49.083827 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:30:49.083808    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17\": container with ID starting with de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17 not found: ID does not exist" containerID="de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"
Sep 15 21:30:49.083895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.083839    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17"} err="failed to get container status \"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17\": rpc error: code = NotFound desc = could not find container \"de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17\": container with ID starting with de631d17533e4b9ce6b718689e5ca1d0e2cd4b6511024b04a4bc342357335b17 not found: ID does not exist"
Sep 15 21:30:49.122815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.122778    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume\") pod \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") "
Sep 15 21:30:49.123033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.122889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxh2k\" (UniqueName: \"kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k\") pod \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\" (UID: \"3f3e7e76-bbb8-4645-a3c6-3310864bd70f\") "
Sep 15 21:30:49.123230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.123206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f3e7e76-bbb8-4645-a3c6-3310864bd70f" (UID: "3f3e7e76-bbb8-4645-a3c6-3310864bd70f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:30:49.124851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.124832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k" (OuterVolumeSpecName: "kube-api-access-sxh2k") pod "3f3e7e76-bbb8-4645-a3c6-3310864bd70f" (UID: "3f3e7e76-bbb8-4645-a3c6-3310864bd70f"). InnerVolumeSpecName "kube-api-access-sxh2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:30:49.224570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.224492    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxh2k\" (UniqueName: \"kubernetes.io/projected/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-kube-api-access-sxh2k\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:30:49.224570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.224520    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3e7e76-bbb8-4645-a3c6-3310864bd70f-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:30:49.280488 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.280452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:49.390171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.390137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:49.425610 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.425573    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:30:49.433110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:49.433078    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-70880c-78c7fb5b57-n9sgq"]
Sep 15 21:30:50.082828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:50.082795    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" path="/var/lib/kubelet/pods/3f3e7e76-bbb8-4645-a3c6-3310864bd70f/volumes"
Sep 15 21:30:50.083206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:50.083133    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc649cba-7308-47a8-81ce-82ce5ec30eb5" path="/var/lib/kubelet/pods/fc649cba-7308-47a8-81ce-82ce5ec30eb5/volumes"
Sep 15 21:30:50.188725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:50.188683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:50.975914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:50.975861    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:51.253309 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:51.253206    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:30:51.682504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:51.682470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.188830 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:52.188797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.419091 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:52.419047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.516004 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:52.511868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:53.094959 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:53.094902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:53.406785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:53.406755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:55.001365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:55.001326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:55.102396 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:55.102349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:55.203404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:55.203367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:55.300257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:55.300174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:56.068742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:56.068702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:56.165089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:56.165059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:56.240335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:56.240303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:58.402189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:58.402149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:58.503490 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:58.503457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:58.679764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:58.679681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:59.358851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:30:59.358815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:00.191552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:00.191521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:00.890743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:00.890706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:00.991910 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:00.991877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:01.101223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.101192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:01.409187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.409138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:01.494571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.494530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:01.496418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.496391    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:31:01.497029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497000    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" containerName="payload-processing"
Sep 15 21:31:01.497029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497029    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" containerName="payload-processing"
Sep 15 21:31:01.497184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497062    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc649cba-7308-47a8-81ce-82ce5ec30eb5" containerName="revoke-keys"
Sep 15 21:31:01.497184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497072    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc649cba-7308-47a8-81ce-82ce5ec30eb5" containerName="revoke-keys"
Sep 15 21:31:01.497184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497152    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3e7e76-bbb8-4645-a3c6-3310864bd70f" containerName="payload-processing"
Sep 15 21:31:01.497184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.497159    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc649cba-7308-47a8-81ce-82ce5ec30eb5" containerName="revoke-keys"
Sep 15 21:31:01.500410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.500394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.502961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.502927    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4e476d59\""
Sep 15 21:31:01.509761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.509732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:31:01.656345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.656310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.656543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.656456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vdj5\" (UniqueName: \"kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.757315 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.757229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.757458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.757322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdj5\" (UniqueName: \"kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.758088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.758064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.766518 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.766482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vdj5\" (UniqueName: \"kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5\") pod \"payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:01.795954 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.795908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:01.811972 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:01.811949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:02.096267 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:31:02.096225    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe60f3d_4475_40b5_bb32_8a0859504d34.slice/crio-fde67f32198f87a6196f9eb517641f4746e3f9a883cd2b6853c2e1501a5aa2d1 WatchSource:0}: Error finding container fde67f32198f87a6196f9eb517641f4746e3f9a883cd2b6853c2e1501a5aa2d1: Status 404 returned error can't find the container with id fde67f32198f87a6196f9eb517641f4746e3f9a883cd2b6853c2e1501a5aa2d1
Sep 15 21:31:02.098520 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:02.098495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:31:02.155167 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:02.155135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" event={"ID":"dfe60f3d-4475-40b5-bb32-8a0859504d34","Type":"ContainerStarted","Data":"fde67f32198f87a6196f9eb517641f4746e3f9a883cd2b6853c2e1501a5aa2d1"}
Sep 15 21:31:02.731077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:02.731045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:03.170061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:03.170016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" event={"ID":"dfe60f3d-4475-40b5-bb32-8a0859504d34","Type":"ContainerStarted","Data":"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"}
Sep 15 21:31:03.170262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:03.170239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:03.194038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:03.193972    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" podStartSLOduration=2.193959131 podStartE2EDuration="2.193959131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:03.191763892 +0000 UTC m=+1357.596085936" watchObservedRunningTime="2026-09-15 21:31:03.193959131 +0000 UTC m=+1357.598281177"
Sep 15 21:31:05.773733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:05.773699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.366978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.366928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.375085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.375058    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"]
Sep 15 21:31:06.377561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.377541    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-779ace-29825130-zrmrx"]
Sep 15 21:31:06.409260 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.409226    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:31:06.410161 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.410123    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" podUID="9c39d710-b545-4c10-8fdb-c441b35d426b" containerName="payload-pre-processing" containerID="cri-o://b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb" gracePeriod=30
Sep 15 21:31:06.468918 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.468877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.566640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.566608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.630747 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.630665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.665354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.665324    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:31:06.704949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.704902    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume\") pod \"9c39d710-b545-4c10-8fdb-c441b35d426b\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") "
Sep 15 21:31:06.705123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.704996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkt8d\" (UniqueName: \"kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d\") pod \"9c39d710-b545-4c10-8fdb-c441b35d426b\" (UID: \"9c39d710-b545-4c10-8fdb-c441b35d426b\") "
Sep 15 21:31:06.705342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.705312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c39d710-b545-4c10-8fdb-c441b35d426b" (UID: "9c39d710-b545-4c10-8fdb-c441b35d426b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:31:06.707169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.707132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d" (OuterVolumeSpecName: "kube-api-access-xkt8d") pod "9c39d710-b545-4c10-8fdb-c441b35d426b" (UID: "9c39d710-b545-4c10-8fdb-c441b35d426b"). InnerVolumeSpecName "kube-api-access-xkt8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:06.806380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.806342    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39d710-b545-4c10-8fdb-c441b35d426b-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:06.806380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.806374    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkt8d\" (UniqueName: \"kubernetes.io/projected/9c39d710-b545-4c10-8fdb-c441b35d426b-kube-api-access-xkt8d\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:06.973065 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:06.972971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:07.069238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.069203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:07.196637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.196599    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c39d710-b545-4c10-8fdb-c441b35d426b" containerID="b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb" exitCode=0
Sep 15 21:31:07.196852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.196664    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"
Sep 15 21:31:07.196852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.196694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" event={"ID":"9c39d710-b545-4c10-8fdb-c441b35d426b","Type":"ContainerDied","Data":"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"}
Sep 15 21:31:07.196852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.196780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq" event={"ID":"9c39d710-b545-4c10-8fdb-c441b35d426b","Type":"ContainerDied","Data":"023e300d3a28aabbf1304f4336c75221d2a59a42113e353520b897339b290485"}
Sep 15 21:31:07.196852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.196811    2560 scope.go:117] "RemoveContainer" containerID="b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"
Sep 15 21:31:07.206701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.206682    2560 scope.go:117] "RemoveContainer" containerID="b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"
Sep 15 21:31:07.207014 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:31:07.206993    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb\": container with ID starting with b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb not found: ID does not exist" containerID="b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"
Sep 15 21:31:07.207088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.207026    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb"} err="failed to get container status \"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb\": rpc error: code = NotFound desc = could not find container \"b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb\": container with ID starting with b313650c9a1832861e0eb7831520f27d11afdabbf3182a0a2f299c98820c8adb not found: ID does not exist"
Sep 15 21:31:07.219873 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.219850    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:31:07.226086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.226027    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-779ace-6c9b976874-hk9tq"]
Sep 15 21:31:07.886436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:07.886402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:08.085799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:08.085747    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="456003fc-4b31-4e31-98d6-2b4906c2f1c1" path="/var/lib/kubelet/pods/456003fc-4b31-4e31-98d6-2b4906c2f1c1/volumes"
Sep 15 21:31:08.086419 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:08.086395    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c39d710-b545-4c10-8fdb-c441b35d426b" path="/var/lib/kubelet/pods/9c39d710-b545-4c10-8fdb-c441b35d426b/volumes"
Sep 15 21:31:08.643786 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:08.643750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:09.455332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:09.455294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:10.403816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:10.403770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:11.034630 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:11.034595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:11.301957 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:11.301839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:12.059117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:12.059076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:12.156597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:12.156557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:14.178390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:14.178361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:31:14.881926 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:14.881886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:14.977485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:14.977453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:15.486806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:15.486769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:15.771318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:15.771216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:16.288771 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:16.288710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:17.565659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:17.565621    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.362155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:18.362115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:31:21.908749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:21.908700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:26.250227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:26.250197    2560 scope.go:117] "RemoveContainer" containerID="88e85accc0aae2392913b3d212f06ff35c68e8246ebb894dc34a78771ffa3ade"
Sep 15 21:31:39.167808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:39.167774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:45.545392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:45.545354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:46.842309 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:46.842278    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:31:46.842746 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:46.842469    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" podUID="94f73fdf-5a20-42b5-b784-8f593741d281" containerName="istio-proxy" containerID="cri-o://a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746" gracePeriod=30
Sep 15 21:31:46.857700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:46.857674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:47.106066 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:47.106026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:47.222447 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:47.222403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:49.541555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:49.541515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:49.798400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:49.798314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:50.357560 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:50.357527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:50.685054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:50.684962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:51.207056 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:51.207022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:52.101142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.101079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:31:52.152721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152734    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152777    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152841    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152868    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.152950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.152890    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.153306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153072    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:31:52.153306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:31:52.153306 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.153481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data" (OuterVolumeSpecName: "istio-data") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:31:52.153481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153338    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfmz4\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4\") pod \"94f73fdf-5a20-42b5-b784-8f593741d281\" (UID: \"94f73fdf-5a20-42b5-b784-8f593741d281\") "
Sep 15 21:31:52.153481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153353    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:31:52.153654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153557    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:31:52.153967 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.153918    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f73fdf-5a20-42b5-b784-8f593741d281-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.154130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.154115    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.154237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.154224    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.154324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.154313    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.154410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.154398    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.155431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.155400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:31:52.155532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.155467    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:31:52.155532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.155476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token" (OuterVolumeSpecName: "istio-token") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:52.155642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.155626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4" (OuterVolumeSpecName: "kube-api-access-gfmz4") pod "94f73fdf-5a20-42b5-b784-8f593741d281" (UID: "94f73fdf-5a20-42b5-b784-8f593741d281"). InnerVolumeSpecName "kube-api-access-gfmz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:52.230416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.230384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:52.255857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.255829    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfmz4\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-kube-api-access-gfmz4\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.255857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.255857    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f73fdf-5a20-42b5-b784-8f593741d281-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.256038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.255867    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f73fdf-5a20-42b5-b784-8f593741d281-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.256038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.255875    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f73fdf-5a20-42b5-b784-8f593741d281-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:31:52.473911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.473819    2560 generic.go:356] "Generic (PLEG): container finished" podID="94f73fdf-5a20-42b5-b784-8f593741d281" containerID="a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746" exitCode=0
Sep 15 21:31:52.473911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.473867    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"
Sep 15 21:31:52.473911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.473876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" event={"ID":"94f73fdf-5a20-42b5-b784-8f593741d281","Type":"ContainerDied","Data":"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"}
Sep 15 21:31:52.474175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.473919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2" event={"ID":"94f73fdf-5a20-42b5-b784-8f593741d281","Type":"ContainerDied","Data":"47c73d75cd997da02371befb216cb9f611d6d0f69e287a9aa36c9c805c0fbdb4"}
Sep 15 21:31:52.474175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.473976    2560 scope.go:117] "RemoveContainer" containerID="a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"
Sep 15 21:31:52.484633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.484616    2560 scope.go:117] "RemoveContainer" containerID="a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"
Sep 15 21:31:52.484917 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:31:52.484893    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746\": container with ID starting with a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746 not found: ID does not exist" containerID="a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"
Sep 15 21:31:52.485012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.484929    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746"} err="failed to get container status \"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746\": rpc error: code = NotFound desc = could not find container \"a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746\": container with ID starting with a6e15a6472b013316d603c5b4487d80ee0f820c37f6fa2c5fbac4e86c1502746 not found: ID does not exist"
Sep 15 21:31:52.497336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.497314    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:31:52.501573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.501552    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-d130a8-openshift-default-7f5b69f4d6-k6cm2"]
Sep 15 21:31:52.640931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:52.640897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:53.415347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:53.415307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:53.488410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:53.488365    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:31:53.514193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:53.514154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:54.083605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:54.083568    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f73fdf-5a20-42b5-b784-8f593741d281" path="/var/lib/kubelet/pods/94f73fdf-5a20-42b5-b784-8f593741d281/volumes"
Sep 15 21:31:54.515509 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:54.515477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.470713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:55.470674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:56.222516 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:56.222477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:56.932546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:56.932512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:57.802694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:57.802656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:57.871904 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:57.871865    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:58.337469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.337435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:58.437362 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.437328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:58.478198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478165    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:31:58.478573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478560    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f73fdf-5a20-42b5-b784-8f593741d281" containerName="istio-proxy"
Sep 15 21:31:58.478618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478574    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f73fdf-5a20-42b5-b784-8f593741d281" containerName="istio-proxy"
Sep 15 21:31:58.478618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478595    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c39d710-b545-4c10-8fdb-c441b35d426b" containerName="payload-pre-processing"
Sep 15 21:31:58.478618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478601    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c39d710-b545-4c10-8fdb-c441b35d426b" containerName="payload-pre-processing"
Sep 15 21:31:58.478759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478670    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c39d710-b545-4c10-8fdb-c441b35d426b" containerName="payload-pre-processing"
Sep 15 21:31:58.478759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.478678    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f73fdf-5a20-42b5-b784-8f593741d281" containerName="istio-proxy"
Sep 15 21:31:58.481965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.481922    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.485649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.485621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-3c4dc8-dockercfg-s8n5j\""
Sep 15 21:31:58.485802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.485683    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-3c4dc8\""
Sep 15 21:31:58.496321 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.496296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:31:58.520633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.520598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.520793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.520772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxz7v\" (UniqueName: \"kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.545648 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.545614    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:31:58.549444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.549420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.561387 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.561359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:31:58.622115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.622081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxz7v\" (UniqueName: \"kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.622329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.622140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.622329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.622182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjngh\" (UniqueName: \"kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.622329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.622205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.622838 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.622816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.630487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.630451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxz7v\" (UniqueName: \"kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v\") pod \"payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.723768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.723729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjngh\" (UniqueName: \"kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.723966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.723780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.724681 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.724658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.733328 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.733295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjngh\" (UniqueName: \"kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh\") pod \"payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.792082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.792040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:58.860868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.860833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:58.892840 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:58.892802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:59.066742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.066712    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:31:59.067540 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:31:59.067514    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db931d3_6140_438b_93c2_f576d122a9fd.slice/crio-56ef383abef8e640f3b39a189ce15b1ad943c056907a6b34d2780e49987902f5 WatchSource:0}: Error finding container 56ef383abef8e640f3b39a189ce15b1ad943c056907a6b34d2780e49987902f5: Status 404 returned error can't find the container with id 56ef383abef8e640f3b39a189ce15b1ad943c056907a6b34d2780e49987902f5
Sep 15 21:31:59.136970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.136930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:31:59.522962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.522841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" event={"ID":"2dd577af-2b37-49b8-9ed5-57982daad8dd","Type":"ContainerStarted","Data":"cfdf8eb3b3c05a8cd44f0f32c67929f9c44e292dd02cb8641de5d4919b88ec5c"}
Sep 15 21:31:59.522962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.522913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" event={"ID":"2dd577af-2b37-49b8-9ed5-57982daad8dd","Type":"ContainerStarted","Data":"cea34180bd5abc24ac1dd507d23d427d4413e6c9ae7abd93499f4a469620dfbb"}
Sep 15 21:31:59.522962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.522957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:31:59.524616 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.524589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" event={"ID":"6db931d3-6140-438b-93c2-f576d122a9fd","Type":"ContainerStarted","Data":"9b9d11d5499d8db6ec097fe1cbc1cad3b27e0141003abe251778769008144eef"}
Sep 15 21:31:59.524756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.524638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" event={"ID":"6db931d3-6140-438b-93c2-f576d122a9fd","Type":"ContainerStarted","Data":"56ef383abef8e640f3b39a189ce15b1ad943c056907a6b34d2780e49987902f5"}
Sep 15 21:31:59.524756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.524668    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:31:59.541887 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.541841    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" podStartSLOduration=1.541825024 podStartE2EDuration="1.541825024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:59.540639495 +0000 UTC m=+1413.944961553" watchObservedRunningTime="2026-09-15 21:31:59.541825024 +0000 UTC m=+1413.946147070"
Sep 15 21:31:59.562230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:31:59.562169    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" podStartSLOduration=1.5621406279999999 podStartE2EDuration="1.562140628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:59.557417264 +0000 UTC m=+1413.961739310" watchObservedRunningTime="2026-09-15 21:31:59.562140628 +0000 UTC m=+1413.966462675"
Sep 15 21:32:10.532552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:10.532510    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:32:10.533025 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:10.533005    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:32:19.851783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:19.851682    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:32:21.310272 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:21.310228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.398022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:21.397984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.782649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:21.782618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:22.582027 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:22.581988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:23.379993 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:23.379957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:23.484408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:23.484377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:23.710532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:23.710441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:24.024013 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:24.023910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:24.087115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:24.087080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:24.191208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:24.191174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:24.531372 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:24.531332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:24.940206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:24.940169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:26.282007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:26.281977    2560 scope.go:117] "RemoveContainer" containerID="56ca4fd6bde7de22889567ebee7ff7c65d7715e0a7db3c413efcbddebb184dce"
Sep 15 21:32:26.856459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:26.856422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:27.569245 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:27.569201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:27.670615 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:27.670575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:27.769785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:27.769750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:28.719566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:28.719524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:29.424491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:29.424458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:29.718302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:29.718278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.381928 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:30.381891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:31.128877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:31.128841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:31.855725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:31.855688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:32.691316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:32.691277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:32.792072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:32.792022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:33.146788 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.146749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:33.246611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.246559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:33.318355 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.318321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:33.358077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.358035    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:32:33.363657 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.363628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.366326 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.366299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7c57b6\""
Sep 15 21:32:33.367418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.367393    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7c57b6-dockercfg-dvmwb\""
Sep 15 21:32:33.372528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.372229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:32:33.471356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.471261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.471521 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.471430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rdlb\" (UniqueName: \"kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.572799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.572754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rdlb\" (UniqueName: \"kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.573012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.572855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.573555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.573535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.580893 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.580861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rdlb\" (UniqueName: \"kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb\") pod \"payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.677123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.677081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:33.950120 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:33.950087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:32:33.951852 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:32:33.951817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a6fefe_ee5f_46ca_9fd7_91d52be22289.slice/crio-56eabcadb28d5c114b462e1b20cd7d945573b04a3596ed15c7b72f9b5316873d WatchSource:0}: Error finding container 56eabcadb28d5c114b462e1b20cd7d945573b04a3596ed15c7b72f9b5316873d: Status 404 returned error can't find the container with id 56eabcadb28d5c114b462e1b20cd7d945573b04a3596ed15c7b72f9b5316873d
Sep 15 21:32:34.750276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:34.750232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" event={"ID":"83a6fefe-ee5f-46ca-9fd7-91d52be22289","Type":"ContainerStarted","Data":"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"}
Sep 15 21:32:34.750659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:34.750291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" event={"ID":"83a6fefe-ee5f-46ca-9fd7-91d52be22289","Type":"ContainerStarted","Data":"56eabcadb28d5c114b462e1b20cd7d945573b04a3596ed15c7b72f9b5316873d"}
Sep 15 21:32:34.750659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:34.750316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:34.766573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:34.766527    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" podStartSLOduration=1.766508987 podStartE2EDuration="1.766508987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:34.766028856 +0000 UTC m=+1449.170350915" watchObservedRunningTime="2026-09-15 21:32:34.766508987 +0000 UTC m=+1449.170831035"
Sep 15 21:32:45.758128 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:45.758094    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:32:48.447863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.447830    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:32:48.451253 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.451235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.454233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.454208    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4e476d59\"/\"kube-root-ca.crt\""
Sep 15 21:32:48.455296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.455271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4e476d59\"/\"e2e-lifecycle-model-4e476d59-kserve-self-signed-certs\""
Sep 15 21:32:48.455401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.455271    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4e476d59\"/\"openshift-service-ca.crt\""
Sep 15 21:32:48.455401 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.455281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4e476d59\"/\"default-dockercfg-5t4rw\""
Sep 15 21:32:48.463524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.463501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:32:48.474684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.474655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:48.620430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.620634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.620634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqvv\" (UniqueName: \"kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.620634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.620824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.620824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.620752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.721782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.721782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.721782 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqvv\" (UniqueName: \"kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.721855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.722202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.722263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.722327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.722297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.723968 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.723945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.724293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.724277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.732567 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.732545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqvv\" (UniqueName: \"kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv\") pod \"e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") " pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:48.760563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:48.760541    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:49.034202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:49.034171    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:32:49.035142 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:32:49.035113    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf69d0ed0_1594_4a4d_b1f1_d7ce7105f737.slice/crio-0486e0f11c4e12e556da8c6794ce11d056ff2c26d1dea26ba31ca47899f1bfd0 WatchSource:0}: Error finding container 0486e0f11c4e12e556da8c6794ce11d056ff2c26d1dea26ba31ca47899f1bfd0: Status 404 returned error can't find the container with id 0486e0f11c4e12e556da8c6794ce11d056ff2c26d1dea26ba31ca47899f1bfd0
Sep 15 21:32:49.847614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:49.847580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" event={"ID":"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737","Type":"ContainerStarted","Data":"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"}
Sep 15 21:32:49.848033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:49.847623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" event={"ID":"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737","Type":"ContainerStarted","Data":"0486e0f11c4e12e556da8c6794ce11d056ff2c26d1dea26ba31ca47899f1bfd0"}
Sep 15 21:32:49.868025 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:49.867971    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" podStartSLOduration=1.867955171 podStartE2EDuration="1.867955171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:49.866028681 +0000 UTC m=+1464.270350743" watchObservedRunningTime="2026-09-15 21:32:49.867955171 +0000 UTC m=+1464.272277217"
Sep 15 21:32:50.871028 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:50.870993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:32:54.803858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:54.803825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:55.548853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:55.548820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:56.280882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:56.280847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:57.006099 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:57.006054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:57.622820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:57.622763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:57.867982 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:57.867949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:58.760944 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:58.760903    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:58.761320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:58.760994    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:58.773768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:58.773739    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:58.919578 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:58.919548    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:32:59.020545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:59.020464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:59.697029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:59.696992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:59.796592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:32:59.796560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:00.402149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:00.402111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:15.256319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:15.256282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:33:16.242399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:16.242369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:16.345735 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:16.345705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:26.194693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:26.194662    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:33:26.197529 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:26.197508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:33:26.308584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:26.308545    2560 scope.go:117] "RemoveContainer" containerID="c195bb16560af3d99b72eca8d3068ced93b6155e97508faf23cbd0538882f182"
Sep 15 21:33:26.319752 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:26.319732    2560 scope.go:117] "RemoveContainer" containerID="36e87079ebbb95ada8babb9dd5da0a5dc31f999916bb50b700f383299a646e36"
Sep 15 21:33:38.262155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:38.262116    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:33:38.960802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:38.960769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:42.140503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:42.140469    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:33:42.164904 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:42.164865    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:57.159607 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.159560    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" podUID="b918c8dd-a91f-493a-a09b-e170c2047b1b" containerName="main" containerID="cri-o://c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be" gracePeriod=45
Sep 15 21:33:57.459369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.459337    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:33:57.527483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527444    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527484    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxgr6\" (UniqueName: \"kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527709 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527622    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527709 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527709 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527684    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache\") pod \"b918c8dd-a91f-493a-a09b-e170c2047b1b\" (UID: \"b918c8dd-a91f-493a-a09b-e170c2047b1b\") "
Sep 15 21:33:57.527966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.527920    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home" (OuterVolumeSpecName: "home") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:33:57.528051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.528015    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:33:57.528134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.528109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:33:57.528134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.528128    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:57.528218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.528145    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:57.529985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.529960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:33:57.530078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.530062    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm" (OuterVolumeSpecName: "dshm") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:33:57.530131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.530090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6" (OuterVolumeSpecName: "kube-api-access-bxgr6") pod "b918c8dd-a91f-493a-a09b-e170c2047b1b" (UID: "b918c8dd-a91f-493a-a09b-e170c2047b1b"). InnerVolumeSpecName "kube-api-access-bxgr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:33:57.629733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.629691    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxgr6\" (UniqueName: \"kubernetes.io/projected/b918c8dd-a91f-493a-a09b-e170c2047b1b-kube-api-access-bxgr6\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:57.629733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.629727    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b918c8dd-a91f-493a-a09b-e170c2047b1b-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:57.629733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.629737    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:57.629733 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:57.629745    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b918c8dd-a91f-493a-a09b-e170c2047b1b-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:33:58.279537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.279506    2560 generic.go:356] "Generic (PLEG): container finished" podID="b918c8dd-a91f-493a-a09b-e170c2047b1b" containerID="c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be" exitCode=0
Sep 15 21:33:58.279949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.279552    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"
Sep 15 21:33:58.279949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.279596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" event={"ID":"b918c8dd-a91f-493a-a09b-e170c2047b1b","Type":"ContainerDied","Data":"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"}
Sep 15 21:33:58.279949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.279638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8" event={"ID":"b918c8dd-a91f-493a-a09b-e170c2047b1b","Type":"ContainerDied","Data":"0bdc53a38b8ecc662a04f2b29df7304c72df5e37edc41a5edaa20b2c1077c5a4"}
Sep 15 21:33:58.279949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.279657    2560 scope.go:117] "RemoveContainer" containerID="c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"
Sep 15 21:33:58.289297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.289275    2560 scope.go:117] "RemoveContainer" containerID="c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"
Sep 15 21:33:58.289642 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:33:58.289621    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be\": container with ID starting with c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be not found: ID does not exist" containerID="c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"
Sep 15 21:33:58.289691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.289652    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be"} err="failed to get container status \"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be\": rpc error: code = NotFound desc = could not find container \"c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be\": container with ID starting with c2f1021e3f8a58677f28ac0dd18f2e9537814782042481f9aa32fab04ae674be not found: ID does not exist"
Sep 15 21:33:58.297959 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.297905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:33:58.303002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:33:58.302974    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-625609/e2e-conflict-a-23fd2eb6-kserve-9cd75bf85-qqkx8"]
Sep 15 21:34:00.083232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:00.083192    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b918c8dd-a91f-493a-a09b-e170c2047b1b" path="/var/lib/kubelet/pods/b918c8dd-a91f-493a-a09b-e170c2047b1b/volumes"
Sep 15 21:34:02.458523 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:02.458470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:02.556921 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:02.556885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:02.743342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:02.743258    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:03.850745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.850704    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"]
Sep 15 21:34:03.851338 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.851317    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b918c8dd-a91f-493a-a09b-e170c2047b1b" containerName="main"
Sep 15 21:34:03.851442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.851341    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b918c8dd-a91f-493a-a09b-e170c2047b1b" containerName="main"
Sep 15 21:34:03.851503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.851479    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b918c8dd-a91f-493a-a09b-e170c2047b1b" containerName="main"
Sep 15 21:34:03.856426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.856396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:03.859664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.859632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:34:03.861136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.861112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"]
Sep 15 21:34:03.994900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:03.994863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx\" (UID: \"b04a6574-12f8-40ba-94a1-a77623df94e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:04.002083 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.002028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:04.095656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.095621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx\" (UID: \"b04a6574-12f8-40ba-94a1-a77623df94e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:04.096230 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.096213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx\" (UID: \"b04a6574-12f8-40ba-94a1-a77623df94e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:04.169653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.169558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:04.442874 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.442832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"]
Sep 15 21:34:04.444707 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:34:04.444670    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04a6574_12f8_40ba_94a1_a77623df94e8.slice/crio-8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3 WatchSource:0}: Error finding container 8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3: Status 404 returned error can't find the container with id 8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3
Sep 15 21:34:04.794444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:04.794406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:05.325009 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:05.324902    2560 generic.go:356] "Generic (PLEG): container finished" podID="b04a6574-12f8-40ba-94a1-a77623df94e8" containerID="75114875901b39238634a7117e29cbf4216b4c5de3a1618cb5e7b96ebb3244fb" exitCode=0
Sep 15 21:34:05.325009 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:05.324990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx" event={"ID":"b04a6574-12f8-40ba-94a1-a77623df94e8","Type":"ContainerDied","Data":"75114875901b39238634a7117e29cbf4216b4c5de3a1618cb5e7b96ebb3244fb"}
Sep 15 21:34:05.325410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:05.325070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx" event={"ID":"b04a6574-12f8-40ba-94a1-a77623df94e8","Type":"ContainerStarted","Data":"8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3"}
Sep 15 21:34:05.693130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:05.693091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:06.374476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:06.374422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:06.479320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:06.479294    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:06.618848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:06.618820    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca\") pod \"b04a6574-12f8-40ba-94a1-a77623df94e8\" (UID: \"b04a6574-12f8-40ba-94a1-a77623df94e8\") "
Sep 15 21:34:06.619297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:06.619266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b04a6574-12f8-40ba-94a1-a77623df94e8" (UID: "b04a6574-12f8-40ba-94a1-a77623df94e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:34:06.719590 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:06.719552    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04a6574-12f8-40ba-94a1-a77623df94e8-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:07.064613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:07.064521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:07.339329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:07.339245    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"
Sep 15 21:34:07.339329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:07.339261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx" event={"ID":"b04a6574-12f8-40ba-94a1-a77623df94e8","Type":"ContainerDied","Data":"8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3"}
Sep 15 21:34:07.339329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:07.339311    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8546780fe91a046ec53376c0dd9faf725e758452143cb391d4106e75f6f451f3"
Sep 15 21:34:07.938470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:07.938434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:08.673561 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:08.673525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:09.384820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:09.384785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:10.104303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:10.104269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:11.255023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:11.254977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:34:19.566476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.566431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:19.611526 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.611494    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:34:19.611799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.611739    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" podUID="dfe60f3d-4475-40b5-bb32-8a0859504d34" containerName="payload-pre-processing" containerID="cri-o://b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c" gracePeriod=30
Sep 15 21:34:19.666563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.666532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:19.765418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.765382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:19.836316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.836221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"]
Sep 15 21:34:19.839222 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.839198    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4e476d59-8l5rx"]
Sep 15 21:34:19.840330 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.840297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:19.861014 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.860989    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:34:19.954231 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.954194    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vdj5\" (UniqueName: \"kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5\") pod \"dfe60f3d-4475-40b5-bb32-8a0859504d34\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") "
Sep 15 21:34:19.954424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.954290    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume\") pod \"dfe60f3d-4475-40b5-bb32-8a0859504d34\" (UID: \"dfe60f3d-4475-40b5-bb32-8a0859504d34\") "
Sep 15 21:34:19.954689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.954663    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfe60f3d-4475-40b5-bb32-8a0859504d34" (UID: "dfe60f3d-4475-40b5-bb32-8a0859504d34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:34:19.956261 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:19.956237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5" (OuterVolumeSpecName: "kube-api-access-4vdj5") pod "dfe60f3d-4475-40b5-bb32-8a0859504d34" (UID: "dfe60f3d-4475-40b5-bb32-8a0859504d34"). InnerVolumeSpecName "kube-api-access-4vdj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:34:20.055566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.055525    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vdj5\" (UniqueName: \"kubernetes.io/projected/dfe60f3d-4475-40b5-bb32-8a0859504d34-kube-api-access-4vdj5\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:20.055566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.055557    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe60f3d-4475-40b5-bb32-8a0859504d34-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:20.083354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.083322    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04a6574-12f8-40ba-94a1-a77623df94e8" path="/var/lib/kubelet/pods/b04a6574-12f8-40ba-94a1-a77623df94e8/volumes"
Sep 15 21:34:20.303548 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.303511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:20.419481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.419442    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfe60f3d-4475-40b5-bb32-8a0859504d34" containerID="b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c" exitCode=0
Sep 15 21:34:20.419655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.419491    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"
Sep 15 21:34:20.419655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.419529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" event={"ID":"dfe60f3d-4475-40b5-bb32-8a0859504d34","Type":"ContainerDied","Data":"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"}
Sep 15 21:34:20.419655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.419584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt" event={"ID":"dfe60f3d-4475-40b5-bb32-8a0859504d34","Type":"ContainerDied","Data":"fde67f32198f87a6196f9eb517641f4746e3f9a883cd2b6853c2e1501a5aa2d1"}
Sep 15 21:34:20.419655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.419609    2560 scope.go:117] "RemoveContainer" containerID="b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"
Sep 15 21:34:20.429311 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.429291    2560 scope.go:117] "RemoveContainer" containerID="b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"
Sep 15 21:34:20.429669 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:34:20.429611    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c\": container with ID starting with b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c not found: ID does not exist" containerID="b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"
Sep 15 21:34:20.429757 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.429677    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c"} err="failed to get container status \"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c\": rpc error: code = NotFound desc = could not find container \"b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c\": container with ID starting with b0e9dcf474a2917c225504e87bd997608e923738fed679fdbdca1f5cf427f36c not found: ID does not exist"
Sep 15 21:34:20.436163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.436140    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:34:20.438864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:20.438843    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e476d59-8976866db-kj6rt"]
Sep 15 21:34:21.065240 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:21.065206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:21.792549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:21.792511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:22.083843 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:22.083760    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe60f3d-4475-40b5-bb32-8a0859504d34" path="/var/lib/kubelet/pods/dfe60f3d-4475-40b5-bb32-8a0859504d34/volumes"
Sep 15 21:34:22.593787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:22.593748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:23.004285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:23.004246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:23.302687 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:23.302598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:24.183117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:24.183080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:24.890521 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:24.890490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:26.358424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:26.358393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:26.458165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:26.458126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:27.985061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:27.985025    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:34:28.082144 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:28.082103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:29.506277 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:29.506244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:38.468115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:38.468076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:34:40.942539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.942493    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:34:40.943163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943143    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe60f3d-4475-40b5-bb32-8a0859504d34" containerName="payload-pre-processing"
Sep 15 21:34:40.943219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943167    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe60f3d-4475-40b5-bb32-8a0859504d34" containerName="payload-pre-processing"
Sep 15 21:34:40.943255 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943222    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04a6574-12f8-40ba-94a1-a77623df94e8" containerName="revoke-keys"
Sep 15 21:34:40.943255 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943230    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04a6574-12f8-40ba-94a1-a77623df94e8" containerName="revoke-keys"
Sep 15 21:34:40.943341 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943330    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04a6574-12f8-40ba-94a1-a77623df94e8" containerName="revoke-keys"
Sep 15 21:34:40.943378 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.943349    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe60f3d-4475-40b5-bb32-8a0859504d34" containerName="payload-pre-processing"
Sep 15 21:34:40.947386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.947369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:40.951099 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.951076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"kube-root-ca.crt\""
Sep 15 21:34:40.951296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.951274    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"auth-test-model-7c57b6-kserve-self-signed-certs\""
Sep 15 21:34:40.951421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.951115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"default-dockercfg-rvhzm\""
Sep 15 21:34:40.951504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.951197    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"openshift-service-ca.crt\""
Sep 15 21:34:40.955587 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.955086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:34:40.966478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:40.966443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:41.058688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.058877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2x8g\" (UniqueName: \"kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.058877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.058877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.059071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.059071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.058977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.159734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.159680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.159927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.159831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.159927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.159875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.159927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.159901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.160082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.159970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2x8g\" (UniqueName: \"kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.160082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.160011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.160189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.160160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.160286 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.160269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.160356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.160341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.162152 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.162124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.162400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.162383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.168916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.168888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2x8g\" (UniqueName: \"kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g\") pod \"auth-test-model-7c57b6-kserve-596d4f647f-mwcd4\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.258668 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.258573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:41.533614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.533581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:34:41.534347 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:34:41.534320    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e83bdbb_a175_4fbe_8b2b_6e7871db4bd5.slice/crio-9d3a6c3779b897ae30ef0f87558cba5b54c2aa8cd8944f4074be49fa1a623cf8 WatchSource:0}: Error finding container 9d3a6c3779b897ae30ef0f87558cba5b54c2aa8cd8944f4074be49fa1a623cf8: Status 404 returned error can't find the container with id 9d3a6c3779b897ae30ef0f87558cba5b54c2aa8cd8944f4074be49fa1a623cf8
Sep 15 21:34:41.548890 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:41.548854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" event={"ID":"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5","Type":"ContainerStarted","Data":"9d3a6c3779b897ae30ef0f87558cba5b54c2aa8cd8944f4074be49fa1a623cf8"}
Sep 15 21:34:42.556006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:42.555968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" event={"ID":"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5","Type":"ContainerStarted","Data":"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"}
Sep 15 21:34:42.574523 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:42.574466    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" podStartSLOduration=2.574450728 podStartE2EDuration="2.574450728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:34:42.572658883 +0000 UTC m=+1576.976980930" watchObservedRunningTime="2026-09-15 21:34:42.574450728 +0000 UTC m=+1576.978772773"
Sep 15 21:34:43.004601 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.004561    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" podUID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" containerName="main" containerID="cri-o://7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9" gracePeriod=45
Sep 15 21:34:43.262556 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.262490    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:34:43.382434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vqvv\" (UniqueName: \"kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382469    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382543    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382560    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir\") pod \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\" (UID: \"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737\") "
Sep 15 21:34:43.382884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382800    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home" (OuterVolumeSpecName: "home") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:34:43.382884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache" (OuterVolumeSpecName: "model-cache") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:34:43.382994 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.382876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:34:43.384762 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.384721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm" (OuterVolumeSpecName: "dshm") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:34:43.384762 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.384753    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv" (OuterVolumeSpecName: "kube-api-access-7vqvv") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "kube-api-access-7vqvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:34:43.384916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.384785    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" (UID: "f69d0ed0-1594-4a4d-b1f1-d7ce7105f737"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:34:43.483997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.483963    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.483997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.483995    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.484201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.484007    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vqvv\" (UniqueName: \"kubernetes.io/projected/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-kube-api-access-7vqvv\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.484201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.484016    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.484201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.484024    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.484201 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.484034    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:34:43.566666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.566572    2560 generic.go:356] "Generic (PLEG): container finished" podID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" containerID="7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9" exitCode=0
Sep 15 21:34:43.566666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.566617    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"
Sep 15 21:34:43.566666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.566655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" event={"ID":"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737","Type":"ContainerDied","Data":"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"}
Sep 15 21:34:43.567233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.566699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26" event={"ID":"f69d0ed0-1594-4a4d-b1f1-d7ce7105f737","Type":"ContainerDied","Data":"0486e0f11c4e12e556da8c6794ce11d056ff2c26d1dea26ba31ca47899f1bfd0"}
Sep 15 21:34:43.567233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.566718    2560 scope.go:117] "RemoveContainer" containerID="7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"
Sep 15 21:34:43.576617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.576599    2560 scope.go:117] "RemoveContainer" containerID="7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"
Sep 15 21:34:43.576926 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:34:43.576905    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9\": container with ID starting with 7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9 not found: ID does not exist" containerID="7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"
Sep 15 21:34:43.577002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.576957    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9"} err="failed to get container status \"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9\": rpc error: code = NotFound desc = could not find container \"7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9\": container with ID starting with 7ecd45b342ea384590cd16738f56b9eb09647f35864097a5862c4da4f74acab9 not found: ID does not exist"
Sep 15 21:34:43.590058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.590032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:34:43.594945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:43.594917    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4e476d59/e2e-lifecycle-model-4e476d59-kserve-66ff759799-klt26"]
Sep 15 21:34:44.083112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:44.083078    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" path="/var/lib/kubelet/pods/f69d0ed0-1594-4a4d-b1f1-d7ce7105f737/volumes"
Sep 15 21:34:51.259128 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:51.259088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:51.259578 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:51.259357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:51.273089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:51.273059    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:34:51.629844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:34:51.629815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:35:02.866246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:02.866208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:35:04.598920 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:04.598887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:05.158580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:05.158544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:05.600487 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:05.600436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:11.214077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:11.214038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:16.165428 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:16.165396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:16.871785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:16.871747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:16.974300 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:16.974267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.058324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.058293    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:35:17.058716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.058704    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" containerName="main"
Sep 15 21:35:17.058763 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.058718    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" containerName="main"
Sep 15 21:35:17.058815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.058807    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69d0ed0-1594-4a4d-b1f1-d7ce7105f737" containerName="main"
Sep 15 21:35:17.062242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.062224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.069972 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.069924    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-625609\"/\"distinct-2-w4-625609-kserve-self-signed-certs\""
Sep 15 21:35:17.078196 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.078170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:35:17.177297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.177211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.215071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.215227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.215227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc96j\" (UniqueName: \"kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.215227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.215335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.215335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.215330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.280327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.280290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.316599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.316599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.316787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.316787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc96j\" (UniqueName: \"kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.316787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.316929 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.316802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.317083 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.317062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.317180 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.317140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.317242 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.317224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.318919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.318898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.319320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.319298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.325896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.325872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc96j\" (UniqueName: \"kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j\") pod \"distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") " pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.370988 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.370923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:17.649283 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.649253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:35:17.650751 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:35:17.650720    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a9bd806_6985_4ac1_adcd_c6946c2acf23.slice/crio-f1db12b7d4973a0c547ad801b2ac9c46c76f1041393c0e64ff0d1cf75448c184 WatchSource:0}: Error finding container f1db12b7d4973a0c547ad801b2ac9c46c76f1041393c0e64ff0d1cf75448c184: Status 404 returned error can't find the container with id f1db12b7d4973a0c547ad801b2ac9c46c76f1041393c0e64ff0d1cf75448c184
Sep 15 21:35:17.785198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.785153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" event={"ID":"5a9bd806-6985-4ac1-adcd-c6946c2acf23","Type":"ContainerStarted","Data":"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"}
Sep 15 21:35:17.785198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.785202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" event={"ID":"5a9bd806-6985-4ac1-adcd-c6946c2acf23","Type":"ContainerStarted","Data":"f1db12b7d4973a0c547ad801b2ac9c46c76f1041393c0e64ff0d1cf75448c184"}
Sep 15 21:35:17.804270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:17.804223    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" podStartSLOduration=0.8042045 podStartE2EDuration="804.2045ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:35:17.802046078 +0000 UTC m=+1612.206368124" watchObservedRunningTime="2026-09-15 21:35:17.8042045 +0000 UTC m=+1612.208526572"
Sep 15 21:35:18.537179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:18.537142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:18.712662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:18.712625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:19.350149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:19.350112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:19.485602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:19.479807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:20.801790 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:20.801750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:26.368508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:26.368470    2560 scope.go:117] "RemoveContainer" containerID="5948a649933b6b04ef5725152cac3680f0fc174d7181180c29e434fbf02d0fe3"
Sep 15 21:35:26.866483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:26.866451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:26.958072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:26.958036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:27.371462 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:27.371430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:27.371865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:27.371479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:27.383950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:27.383915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:27.618380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:27.618347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:27.859338 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:27.859307    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:35:32.207101 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:32.207064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:34.906049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:34.906014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:35.090524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:35.090491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:35.246368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:35.246282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:35.801833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:35.801784    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:35:39.665484 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:39.665443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:45.628123 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:45.628084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:45.847653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:45.847611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:46.522051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:35:46.521999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:03.622423 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:03.622388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:03.721347 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:03.721312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:06.746539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:06.746502    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:08.170494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:08.170451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:36:12.810645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:12.810612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:12.913045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:12.913004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:13.134051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:13.134021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:13.495481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:13.495392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:13.823801 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:13.823710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:16.195246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:16.195211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:16.828698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:16.828660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:16.926390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:16.926351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:17.656310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:17.656267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:18.546011 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:18.545974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:19.378078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:19.378042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:20.190591 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:20.190558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:20.913243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:20.913207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:21.618196 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:21.618156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:22.413812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:22.413778    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:22.501217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:22.501183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:22.604107 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:22.604075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:22.894851 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:22.894820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:22.973464 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:22.973426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:23.016665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.016630    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:36:23.020623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.020604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.023237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.023216    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0753ad-dockercfg-rtqdx\""
Sep 15 21:36:23.023318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.023219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0753ad\""
Sep 15 21:36:23.032855 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.032829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:36:23.188478 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.188388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkcw\" (UniqueName: \"kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.188660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.188495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.289613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.289571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkcw\" (UniqueName: \"kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.289819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.289671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.290416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.290395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.298224 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.298198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkcw\" (UniqueName: \"kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw\") pod \"payload-processing-e2e-api-a-0753ad-99944f755-5tjr5\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") " pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.332196 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.332162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:23.609213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:23.609185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:36:23.610749 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:36:23.610721    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ebe5b7_2800_410b_b6a6_cfe04f2ef999.slice/crio-4658a232d13690115b52263860747905c0cf58694baec64e0179addc7a48e494 WatchSource:0}: Error finding container 4658a232d13690115b52263860747905c0cf58694baec64e0179addc7a48e494: Status 404 returned error can't find the container with id 4658a232d13690115b52263860747905c0cf58694baec64e0179addc7a48e494
Sep 15 21:36:24.197555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:24.197510    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" event={"ID":"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999","Type":"ContainerStarted","Data":"de4323e32f4ca0e27a28fc4b3d0c2553ee63248dc691ef95b74ffbd19bc8d9bd"}
Sep 15 21:36:24.197760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:24.197572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" event={"ID":"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999","Type":"ContainerStarted","Data":"4658a232d13690115b52263860747905c0cf58694baec64e0179addc7a48e494"}
Sep 15 21:36:24.197760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:24.197599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:24.214342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:24.214291    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" podStartSLOduration=2.214275169 podStartE2EDuration="2.214275169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:36:24.213331664 +0000 UTC m=+1678.617653726" watchObservedRunningTime="2026-09-15 21:36:24.214275169 +0000 UTC m=+1678.618597220"
Sep 15 21:36:26.400881 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:26.400842    2560 scope.go:117] "RemoveContainer" containerID="d2282d712e3d2b8e4200c4a5059797ce34873b5033b94f7f8e36e78277f3c7e9"
Sep 15 21:36:26.410059 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:26.410037    2560 scope.go:117] "RemoveContainer" containerID="9dfd289a7fee428f591cbceac6d7b71d6d9bd56f01ab7c2d09ddc0ad01e4410a"
Sep 15 21:36:34.952902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:34.952864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:35.206539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:35.206386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:36:35.255208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:35.255177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:36.175506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:36.175454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:37.158165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:37.158122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:38.108077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:38.108042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:38.886618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:38.886584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:39.673313 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:39.673265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:39.963642 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:39.963556    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:36:39.972093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:39.972058    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:36:40.047888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:40.047852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:40.488291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:40.488259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:41.263143 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:41.263110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:41.263564 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:41.263222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:36:41.721189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:41.721153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:42.165531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:42.165498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:42.273664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:42.273627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:42.476783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:42.476664    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:42.950686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:42.950653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:43.129732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:43.129688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:44.095274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:44.095245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:44.889665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:44.889637    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:45.763313 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:45.763277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:46.053394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:46.053295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:46.147966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:46.147903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:46.931494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:46.931461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:48.099015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:48.098910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:48.915622 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:48.915587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:48.982141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:48.982104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.312386 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.312306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.514945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.514897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.666844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.666808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.734971 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.734921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:36:49.739006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.738983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.742082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.742062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-30e32e-dockercfg-9xv48\""
Sep 15 21:36:49.742262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.742244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-30e32e\""
Sep 15 21:36:49.773142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.773107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:36:49.848875 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.848826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df52b\" (UniqueName: \"kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.849080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.848930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.949600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.949508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df52b\" (UniqueName: \"kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.949600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.949583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.950413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.950392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:49.958849 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:49.958823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df52b\" (UniqueName: \"kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b\") pod \"payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:50.049691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:50.049661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:50.304329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:50.304191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:50.323985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:50.323959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:36:50.325058 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:36:50.325028    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642cac3d_b299_4d1f_af6b_463e98d9a503.slice/crio-67f12836d1fd7ecb219e894579fe04cf3572869a56183b01564eec71b032d76e WatchSource:0}: Error finding container 67f12836d1fd7ecb219e894579fe04cf3572869a56183b01564eec71b032d76e: Status 404 returned error can't find the container with id 67f12836d1fd7ecb219e894579fe04cf3572869a56183b01564eec71b032d76e
Sep 15 21:36:50.372388 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:50.372330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" event={"ID":"642cac3d-b299-4d1f-af6b-463e98d9a503","Type":"ContainerStarted","Data":"67f12836d1fd7ecb219e894579fe04cf3572869a56183b01564eec71b032d76e"}
Sep 15 21:36:51.100324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:51.100284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:51.380915 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:51.380812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" event={"ID":"642cac3d-b299-4d1f-af6b-463e98d9a503","Type":"ContainerStarted","Data":"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"}
Sep 15 21:36:51.381384 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:51.380931    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:36:51.399584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:51.399535    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" podStartSLOduration=2.399516539 podStartE2EDuration="2.399516539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:36:51.396770172 +0000 UTC m=+1705.801092221" watchObservedRunningTime="2026-09-15 21:36:51.399516539 +0000 UTC m=+1705.803838617"
Sep 15 21:36:52.176226 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:52.176180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:53.078471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:53.078434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:53.913535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:53.913499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:54.803900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:54.803867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:54.983964 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:54.983905    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" podUID="00dcf703-c6b7-40da-8214-7282ee64aff1" containerName="main" containerID="cri-o://39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a" gracePeriod=45
Sep 15 21:36:54.992377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:54.992322    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" podUID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" containerName="main" containerID="cri-o://2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178" gracePeriod=45
Sep 15 21:36:55.242008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.241980    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:36:55.273562 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.273531    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:36:55.304677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.304649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.304895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.304687    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.304895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.304801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97zm6\" (UniqueName: \"kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.305047 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.304898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.305047 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.305211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.305274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305252    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home\") pod \"00dcf703-c6b7-40da-8214-7282ee64aff1\" (UID: \"00dcf703-c6b7-40da-8214-7282ee64aff1\") "
Sep 15 21:36:55.305671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache" (OuterVolumeSpecName: "model-cache") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.305671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305643    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home" (OuterVolumeSpecName: "home") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.305871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305746    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.305871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305765    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.305871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.305778    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.307254 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.307227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm" (OuterVolumeSpecName: "dshm") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.307605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.307456    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6" (OuterVolumeSpecName: "kube-api-access-97zm6") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "kube-api-access-97zm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:36:55.307605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.307555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00dcf703-c6b7-40da-8214-7282ee64aff1" (UID: "00dcf703-c6b7-40da-8214-7282ee64aff1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:36:55.406128 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406187    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prcdb\" (UniqueName: \"kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406257    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406494 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir\") pod \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\" (UID: \"d83f470b-1e74-4657-96b8-1b1cc1f679a2\") "
Sep 15 21:36:55.406580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home" (OuterVolumeSpecName: "home") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.406727 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.406812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406800    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97zm6\" (UniqueName: \"kubernetes.io/projected/00dcf703-c6b7-40da-8214-7282ee64aff1-kube-api-access-97zm6\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.406871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406815    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.406871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406828    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dcf703-c6b7-40da-8214-7282ee64aff1-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.406871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406840    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.406871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.406851    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dcf703-c6b7-40da-8214-7282ee64aff1-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.407141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.407393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407370    2560 generic.go:356] "Generic (PLEG): container finished" podID="00dcf703-c6b7-40da-8214-7282ee64aff1" containerID="39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a" exitCode=0
Sep 15 21:36:55.407502 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407480    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"
Sep 15 21:36:55.407565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" event={"ID":"00dcf703-c6b7-40da-8214-7282ee64aff1","Type":"ContainerDied","Data":"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"}
Sep 15 21:36:55.407624 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp" event={"ID":"00dcf703-c6b7-40da-8214-7282ee64aff1","Type":"ContainerDied","Data":"c1e32dbed908616103d71866af8c94f42a0504df328546308218f815c2c7e58d"}
Sep 15 21:36:55.407624 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.407588    2560 scope.go:117] "RemoveContainer" containerID="39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"
Sep 15 21:36:55.408666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.408638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:36:55.408806 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.408780    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb" (OuterVolumeSpecName: "kube-api-access-prcdb") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "kube-api-access-prcdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:36:55.409149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.409127    2560 generic.go:356] "Generic (PLEG): container finished" podID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" containerID="2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178" exitCode=0
Sep 15 21:36:55.409233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.409171    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"
Sep 15 21:36:55.409233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.409174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm" (OuterVolumeSpecName: "dshm") pod "d83f470b-1e74-4657-96b8-1b1cc1f679a2" (UID: "d83f470b-1e74-4657-96b8-1b1cc1f679a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:36:55.409233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.409215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" event={"ID":"d83f470b-1e74-4657-96b8-1b1cc1f679a2","Type":"ContainerDied","Data":"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"}
Sep 15 21:36:55.409358 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.409255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k" event={"ID":"d83f470b-1e74-4657-96b8-1b1cc1f679a2","Type":"ContainerDied","Data":"dcbad63d3d675b65e7959c9e6ea672a4f1848ce2f3d0561270d382b874a05dff"}
Sep 15 21:36:55.418342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.418318    2560 scope.go:117] "RemoveContainer" containerID="39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"
Sep 15 21:36:55.418698 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:36:55.418625    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a\": container with ID starting with 39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a not found: ID does not exist" containerID="39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"
Sep 15 21:36:55.418698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.418654    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a"} err="failed to get container status \"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a\": rpc error: code = NotFound desc = could not find container \"39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a\": container with ID starting with 39234680c5a24d027a61c3bb51ee2f3b89040e80b7c98b6aa993668897bfd47a not found: ID does not exist"
Sep 15 21:36:55.418698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.418678    2560 scope.go:117] "RemoveContainer" containerID="2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"
Sep 15 21:36:55.427301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.427285    2560 scope.go:117] "RemoveContainer" containerID="2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"
Sep 15 21:36:55.427551 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:36:55.427533    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178\": container with ID starting with 2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178 not found: ID does not exist" containerID="2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"
Sep 15 21:36:55.427614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.427555    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178"} err="failed to get container status \"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178\": rpc error: code = NotFound desc = could not find container \"2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178\": container with ID starting with 2ccdd8d1919c4728c9adc865431f8647eff5877c4b1a449ee3ec3b66df33e178 not found: ID does not exist"
Sep 15 21:36:55.434814 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.434790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:36:55.439559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.439538    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/premium-w0-a276f9-kserve-565c8c7957-g4xjp"]
Sep 15 21:36:55.450693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.450669    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:36:55.455395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.455373    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a276f9/simulator-w0-a276f9-kserve-5c99cf54bd-hrk5k"]
Sep 15 21:36:55.508411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.508380    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d83f470b-1e74-4657-96b8-1b1cc1f679a2-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.508411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.508409    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prcdb\" (UniqueName: \"kubernetes.io/projected/d83f470b-1e74-4657-96b8-1b1cc1f679a2-kube-api-access-prcdb\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.508593 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.508419    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.508593 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.508429    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d83f470b-1e74-4657-96b8-1b1cc1f679a2-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:55.721754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:55.721671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:56.083692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:56.083657    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00dcf703-c6b7-40da-8214-7282ee64aff1" path="/var/lib/kubelet/pods/00dcf703-c6b7-40da-8214-7282ee64aff1/volumes"
Sep 15 21:36:56.084099 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:56.084084    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" path="/var/lib/kubelet/pods/d83f470b-1e74-4657-96b8-1b1cc1f679a2/volumes"
Sep 15 21:36:56.598729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:56.598696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:57.283153 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.283117    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:36:57.283692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.283658    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" podUID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" containerName="maas-api" containerID="cri-o://5c7b2884fef6e4a13804465166c7641e647e828af9bae6df7536e910ea74e51b" gracePeriod=30
Sep 15 21:36:57.312670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.311141    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"]
Sep 15 21:36:57.312670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.312638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:57.320832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.320802    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a276f9-29825130-pqznv"]
Sep 15 21:36:57.340922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.340739    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:36:57.341192 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.341160    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" podUID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" containerName="payload-processing" containerID="cri-o://127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5" gracePeriod=30
Sep 15 21:36:57.405980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.405910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:57.425327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.425290    2560 generic.go:356] "Generic (PLEG): container finished" podID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" containerID="5c7b2884fef6e4a13804465166c7641e647e828af9bae6df7536e910ea74e51b" exitCode=0
Sep 15 21:36:57.425503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.425364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" event={"ID":"ebb8d28b-936d-4070-bc92-e709e6a7b9af","Type":"ContainerDied","Data":"5c7b2884fef6e4a13804465166c7641e647e828af9bae6df7536e910ea74e51b"}
Sep 15 21:36:57.505523 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.505485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:57.592055 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.592025    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:36:57.606773 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.606733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:57.628225 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.628196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:36:57.731575 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjw67\" (UniqueName: \"kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67\") pod \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") "
Sep 15 21:36:57.731759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs\") pod \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") "
Sep 15 21:36:57.731759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") pod \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") "
Sep 15 21:36:57.731759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca\") pod \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\" (UID: \"ebb8d28b-936d-4070-bc92-e709e6a7b9af\") "
Sep 15 21:36:57.731759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731723    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqw5m\" (UniqueName: \"kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m\") pod \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") "
Sep 15 21:36:57.731996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.731806    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume\") pod \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\" (UID: \"6a6f2d69-7fec-4f39-9480-1afcfcbf575a\") "
Sep 15 21:36:57.732216 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.732178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebb8d28b-936d-4070-bc92-e709e6a7b9af" (UID: "ebb8d28b-936d-4070-bc92-e709e6a7b9af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:36:57.732377 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.732349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a6f2d69-7fec-4f39-9480-1afcfcbf575a" (UID: "6a6f2d69-7fec-4f39-9480-1afcfcbf575a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:36:57.733866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.733843    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebb8d28b-936d-4070-bc92-e709e6a7b9af" (UID: "ebb8d28b-936d-4070-bc92-e709e6a7b9af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:36:57.733991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.733918    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67" (OuterVolumeSpecName: "kube-api-access-fjw67") pod "ebb8d28b-936d-4070-bc92-e709e6a7b9af" (UID: "ebb8d28b-936d-4070-bc92-e709e6a7b9af"). InnerVolumeSpecName "kube-api-access-fjw67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:36:57.734172 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.734156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebb8d28b-936d-4070-bc92-e709e6a7b9af" (UID: "ebb8d28b-936d-4070-bc92-e709e6a7b9af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:36:57.734215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.734180    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m" (OuterVolumeSpecName: "kube-api-access-rqw5m") pod "6a6f2d69-7fec-4f39-9480-1afcfcbf575a" (UID: "6a6f2d69-7fec-4f39-9480-1afcfcbf575a"). InnerVolumeSpecName "kube-api-access-rqw5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833381    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833413    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjw67\" (UniqueName: \"kubernetes.io/projected/ebb8d28b-936d-4070-bc92-e709e6a7b9af-kube-api-access-fjw67\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833424    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-metrics-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833433    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebb8d28b-936d-4070-bc92-e709e6a7b9af-maas-api-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833441    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb8d28b-936d-4070-bc92-e709e6a7b9af-openshift-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.833473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.833471    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqw5m\" (UniqueName: \"kubernetes.io/projected/6a6f2d69-7fec-4f39-9480-1afcfcbf575a-kube-api-access-rqw5m\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:36:57.900159 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:57.900125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:58.005082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.005045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:58.082516 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.082484    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6826b52b-fa9f-46d0-88a2-12b24a924f91" path="/var/lib/kubelet/pods/6826b52b-fa9f-46d0-88a2-12b24a924f91/volumes"
Sep 15 21:36:58.432789 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.432736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"
Sep 15 21:36:58.432789 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.432782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h" event={"ID":"ebb8d28b-936d-4070-bc92-e709e6a7b9af","Type":"ContainerDied","Data":"b99956cd8c17f955faad7aab0d4ec232b0172893c35a737bdfe1d0927a39efd6"}
Sep 15 21:36:58.433365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.432844    2560 scope.go:117] "RemoveContainer" containerID="5c7b2884fef6e4a13804465166c7641e647e828af9bae6df7536e910ea74e51b"
Sep 15 21:36:58.434459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.434432    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" containerID="127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5" exitCode=0
Sep 15 21:36:58.434543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.434478    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"
Sep 15 21:36:58.434543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.434481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" event={"ID":"6a6f2d69-7fec-4f39-9480-1afcfcbf575a","Type":"ContainerDied","Data":"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"}
Sep 15 21:36:58.434543 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.434521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8" event={"ID":"6a6f2d69-7fec-4f39-9480-1afcfcbf575a","Type":"ContainerDied","Data":"06993bba9db1deab212c060b64bfe63854486370725bf315cda2cb2d728ea584"}
Sep 15 21:36:58.442325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.442307    2560 scope.go:117] "RemoveContainer" containerID="127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"
Sep 15 21:36:58.450741 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.450721    2560 scope.go:117] "RemoveContainer" containerID="127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"
Sep 15 21:36:58.451067 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:36:58.451044    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5\": container with ID starting with 127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5 not found: ID does not exist" containerID="127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"
Sep 15 21:36:58.451138 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.451075    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5"} err="failed to get container status \"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5\": rpc error: code = NotFound desc = could not find container \"127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5\": container with ID starting with 127da64b190e37a0a294bbd068588ecf7a6828e1455c14ff96a9a3743eececd5 not found: ID does not exist"
Sep 15 21:36:58.452393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.452372    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:36:58.455802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.455782    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a276f9-65b5c457-2dtx8"]
Sep 15 21:36:58.466370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.466345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:36:58.472138 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:58.472117    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a276f9-8685cb8fcf-rrf8h"]
Sep 15 21:36:59.048108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:36:59.048074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:00.004777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:00.004723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:00.083297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:00.083266    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" path="/var/lib/kubelet/pods/6a6f2d69-7fec-4f39-9480-1afcfcbf575a/volumes"
Sep 15 21:37:00.083649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:00.083637    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" path="/var/lib/kubelet/pods/ebb8d28b-936d-4070-bc92-e709e6a7b9af/volumes"
Sep 15 21:37:00.744605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:00.744571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:01.490115 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:01.490080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:02.364158 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:02.364119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:02.390007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:02.389979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:37:03.182075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:03.182028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:03.987459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:03.987432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:04.087209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:04.087162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:04.188977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:04.188917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:04.272640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:04.272548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:05.007124 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:05.007086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:05.750213 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:05.750172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:05.854100 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:05.854067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:06.812066 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:06.812029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:07.519048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:07.519013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:08.398277 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.398239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:08.628014 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.627958    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"]
Sep 15 21:37:08.628962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.628909    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" containerName="main"
Sep 15 21:37:08.628962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.628962    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" containerName="main"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.628994    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" containerName="payload-processing"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629005    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" containerName="payload-processing"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629030    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dcf703-c6b7-40da-8214-7282ee64aff1" containerName="main"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629038    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dcf703-c6b7-40da-8214-7282ee64aff1" containerName="main"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629062    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" containerName="maas-api"
Sep 15 21:37:08.629131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629071    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" containerName="maas-api"
Sep 15 21:37:08.629404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629309    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00dcf703-c6b7-40da-8214-7282ee64aff1" containerName="main"
Sep 15 21:37:08.629404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629321    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83f470b-1e74-4657-96b8-1b1cc1f679a2" containerName="main"
Sep 15 21:37:08.629404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629339    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb8d28b-936d-4070-bc92-e709e6a7b9af" containerName="maas-api"
Sep 15 21:37:08.629404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.629357    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6f2d69-7fec-4f39-9480-1afcfcbf575a" containerName="payload-processing"
Sep 15 21:37:08.634899 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.634875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:08.637658 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.637633    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:37:08.637874 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.637858    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:37:08.644504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.644481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"]
Sep 15 21:37:08.744225 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.744140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl\" (UID: \"ead4363b-197b-452d-9224-b675480d83fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:08.845471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.845432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl\" (UID: \"ead4363b-197b-452d-9224-b675480d83fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:08.846141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.846121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl\" (UID: \"ead4363b-197b-452d-9224-b675480d83fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:08.946430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:08.946390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:09.227290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:09.227258    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"]
Sep 15 21:37:09.228795 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:37:09.228752    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead4363b_197b_452d_9224_b675480d83fd.slice/crio-15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f WatchSource:0}: Error finding container 15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f: Status 404 returned error can't find the container with id 15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f
Sep 15 21:37:09.324846 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:09.324811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:09.505248 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:09.505209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl" event={"ID":"ead4363b-197b-452d-9224-b675480d83fd","Type":"ContainerStarted","Data":"c9792a1603e9ebfd42713beee14543eb18b49a58bf018ac5208095958c8b7542"}
Sep 15 21:37:09.505653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:09.505269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl" event={"ID":"ead4363b-197b-452d-9224-b675480d83fd","Type":"ContainerStarted","Data":"15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f"}
Sep 15 21:37:09.531617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:09.531524    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl" podStartSLOduration=1.531506845 podStartE2EDuration="1.531506845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:37:09.527235956 +0000 UTC m=+1723.931558001" watchObservedRunningTime="2026-09-15 21:37:09.531506845 +0000 UTC m=+1723.935828898"
Sep 15 21:37:10.181292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:10.181190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:10.513826 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:10.513736    2560 generic.go:356] "Generic (PLEG): container finished" podID="ead4363b-197b-452d-9224-b675480d83fd" containerID="c9792a1603e9ebfd42713beee14543eb18b49a58bf018ac5208095958c8b7542" exitCode=0
Sep 15 21:37:10.514202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:10.513828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl" event={"ID":"ead4363b-197b-452d-9224-b675480d83fd","Type":"ContainerDied","Data":"c9792a1603e9ebfd42713beee14543eb18b49a58bf018ac5208095958c8b7542"}
Sep 15 21:37:10.881503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:10.881463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:11.660023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:11.659995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:11.774018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:11.773897    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca\") pod \"ead4363b-197b-452d-9224-b675480d83fd\" (UID: \"ead4363b-197b-452d-9224-b675480d83fd\") "
Sep 15 21:37:11.774264 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:11.774240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ead4363b-197b-452d-9224-b675480d83fd" (UID: "ead4363b-197b-452d-9224-b675480d83fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:11.792683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:11.792649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:11.874997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:11.874926    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead4363b-197b-452d-9224-b675480d83fd-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:12.527453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:12.527419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"
Sep 15 21:37:12.527653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:12.527465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl" event={"ID":"ead4363b-197b-452d-9224-b675480d83fd","Type":"ContainerDied","Data":"15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f"}
Sep 15 21:37:12.527653 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:12.527514    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15bbbbcf3ac5da188ce14310190b65f2212ef8675c491dfcfa761c3633132d5f"
Sep 15 21:37:12.652714 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:12.652679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.375691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:13.375654    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:14.121446 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:14.121403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:15.014485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:15.014445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:17.413165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:17.413133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:17.510200 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:17.510156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:18.255153 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:18.255113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:18.795366 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:18.795332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:19.716445 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:19.716413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:23.991689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:23.991631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.395759 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.395723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.430382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.430347    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:37:25.430597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.430573    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" podUID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" containerName="payload-processing" containerID="cri-o://de4323e32f4ca0e27a28fc4b3d0c2553ee63248dc691ef95b74ffbd19bc8d9bd" gracePeriod=30
Sep 15 21:37:25.474699 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.474660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.577922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.577877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.610795 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.610767    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" containerID="de4323e32f4ca0e27a28fc4b3d0c2553ee63248dc691ef95b74ffbd19bc8d9bd" exitCode=0
Sep 15 21:37:25.610956 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.610850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" event={"ID":"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999","Type":"ContainerDied","Data":"de4323e32f4ca0e27a28fc4b3d0c2553ee63248dc691ef95b74ffbd19bc8d9bd"}
Sep 15 21:37:25.615108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.615079    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"]
Sep 15 21:37:25.618019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.617992    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0753ad-xwrxl"]
Sep 15 21:37:25.676314 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.676284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.679338 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.679307    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:37:25.700116 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.700082    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume\") pod \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") "
Sep 15 21:37:25.700238 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.700165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stkcw\" (UniqueName: \"kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw\") pod \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\" (UID: \"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999\") "
Sep 15 21:37:25.700505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.700478    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" (UID: "a5ebe5b7-2800-410b-b6a6-cfe04f2ef999"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:25.702701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.702659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw" (OuterVolumeSpecName: "kube-api-access-stkcw") pod "a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" (UID: "a5ebe5b7-2800-410b-b6a6-cfe04f2ef999"). InnerVolumeSpecName "kube-api-access-stkcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:25.801049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.801006    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:25.801049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.801041    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stkcw\" (UniqueName: \"kubernetes.io/projected/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999-kube-api-access-stkcw\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:25.960856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:25.960740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:26.083738 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.083698    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead4363b-197b-452d-9224-b675480d83fd" path="/var/lib/kubelet/pods/ead4363b-197b-452d-9224-b675480d83fd/volumes"
Sep 15 21:37:26.104825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.104786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:26.437193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.437158    2560 scope.go:117] "RemoveContainer" containerID="94e46c8e3f414ba02e5855fbaa34ce9f836f395e0ab861d38b57172d20a3f424"
Sep 15 21:37:26.446466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.446445    2560 scope.go:117] "RemoveContainer" containerID="24015a6aa382adf7faa35cdfd528b36dd8bc1776ee5373408bb91c909b7ed2f3"
Sep 15 21:37:26.618235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.618196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"
Sep 15 21:37:26.618435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.618237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5" event={"ID":"a5ebe5b7-2800-410b-b6a6-cfe04f2ef999","Type":"ContainerDied","Data":"4658a232d13690115b52263860747905c0cf58694baec64e0179addc7a48e494"}
Sep 15 21:37:26.618435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.618306    2560 scope.go:117] "RemoveContainer" containerID="de4323e32f4ca0e27a28fc4b3d0c2553ee63248dc691ef95b74ffbd19bc8d9bd"
Sep 15 21:37:26.634578 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.634522    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:37:26.637615 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.637586    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0753ad-99944f755-5tjr5"]
Sep 15 21:37:26.855370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:26.855336    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:27.689317 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:27.689275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:28.082206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:28.082111    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" path="/var/lib/kubelet/pods/a5ebe5b7-2800-410b-b6a6-cfe04f2ef999/volumes"
Sep 15 21:37:28.494430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:28.494394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:29.220275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:29.220237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:29.408455 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:29.408417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:37:30.193077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:30.193044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:30.917803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:30.917765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:32.460609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:32.460577    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:32.560621 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:32.560589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:32.705412 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:32.705383    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:33.016097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016062    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"]
Sep 15 21:37:33.016485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016472    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" containerName="payload-processing"
Sep 15 21:37:33.016531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016486    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" containerName="payload-processing"
Sep 15 21:37:33.016531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016511    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead4363b-197b-452d-9224-b675480d83fd" containerName="revoke-keys"
Sep 15 21:37:33.016531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016517    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead4363b-197b-452d-9224-b675480d83fd" containerName="revoke-keys"
Sep 15 21:37:33.016623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016575    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead4363b-197b-452d-9224-b675480d83fd" containerName="revoke-keys"
Sep 15 21:37:33.016623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.016586    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ebe5b7-2800-410b-b6a6-cfe04f2ef999" containerName="payload-processing"
Sep 15 21:37:33.019852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.019835    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:33.022542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.022521    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:37:33.022812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.022792    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:37:33.029274 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.029252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"]
Sep 15 21:37:33.072093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.072055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5\" (UID: \"a4f8eead-9384-4731-b19a-cfe9ed478fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:33.173020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.172982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5\" (UID: \"a4f8eead-9384-4731-b19a-cfe9ed478fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:33.173618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.173599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5\" (UID: \"a4f8eead-9384-4731-b19a-cfe9ed478fe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:33.331564 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.331480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:33.513545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.513515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:33.610745 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.610715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"]
Sep 15 21:37:33.612167 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:37:33.612139    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f8eead_9384_4731_b19a_cfe9ed478fe4.slice/crio-d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde WatchSource:0}: Error finding container d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde: Status 404 returned error can't find the container with id d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde
Sep 15 21:37:33.663352 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:33.663311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5" event={"ID":"a4f8eead-9384-4731-b19a-cfe9ed478fe4","Type":"ContainerStarted","Data":"d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde"}
Sep 15 21:37:34.478866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:34.478777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:34.670441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:34.670403    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4f8eead-9384-4731-b19a-cfe9ed478fe4" containerID="4f059e54d36d39cd6c245bb7664dbf318d949cd403f4cab112d08f50162d0f6b" exitCode=0
Sep 15 21:37:34.670805 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:34.670482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5" event={"ID":"a4f8eead-9384-4731-b19a-cfe9ed478fe4","Type":"ContainerDied","Data":"4f059e54d36d39cd6c245bb7664dbf318d949cd403f4cab112d08f50162d0f6b"}
Sep 15 21:37:35.421161 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:35.421126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:35.811793 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:35.811767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:35.901212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:35.901173    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca\") pod \"a4f8eead-9384-4731-b19a-cfe9ed478fe4\" (UID: \"a4f8eead-9384-4731-b19a-cfe9ed478fe4\") "
Sep 15 21:37:35.901556 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:35.901532    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4f8eead-9384-4731-b19a-cfe9ed478fe4" (UID: "a4f8eead-9384-4731-b19a-cfe9ed478fe4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:36.002517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:36.002432    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f8eead-9384-4731-b19a-cfe9ed478fe4-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:36.262275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:36.262184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:36.684864 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:36.684834    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"
Sep 15 21:37:36.685064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:36.684834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5" event={"ID":"a4f8eead-9384-4731-b19a-cfe9ed478fe4","Type":"ContainerDied","Data":"d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde"}
Sep 15 21:37:36.685064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:36.684976    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d27d798a042f2aebae0fb64f05c8aab209c11d78c3f1a89669c404ba139d9fde"
Sep 15 21:37:37.082441 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:37.082353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:37.807964 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:37.807906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:38.797017 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:38.796972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:39.667958 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:39.667889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:48.792015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:48.791976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:48.825436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:48.825401    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:37:48.825655 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:48.825630    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" podUID="642cac3d-b299-4d1f-af6b-463e98d9a503" containerName="payload-pre-processing" containerID="cri-o://7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4" gracePeriod=30
Sep 15 21:37:48.915513 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:48.915477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.024275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.024244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.064705 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.064671    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"]
Sep 15 21:37:49.067481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.067459    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30e32e-mr5g5"]
Sep 15 21:37:49.083344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.083323    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:37:49.106471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.106371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.236600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.236563    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df52b\" (UniqueName: \"kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b\") pod \"642cac3d-b299-4d1f-af6b-463e98d9a503\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") "
Sep 15 21:37:49.236784 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.236661    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume\") pod \"642cac3d-b299-4d1f-af6b-463e98d9a503\" (UID: \"642cac3d-b299-4d1f-af6b-463e98d9a503\") "
Sep 15 21:37:49.237105 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.237085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "642cac3d-b299-4d1f-af6b-463e98d9a503" (UID: "642cac3d-b299-4d1f-af6b-463e98d9a503"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:49.238654 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.238628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b" (OuterVolumeSpecName: "kube-api-access-df52b") pod "642cac3d-b299-4d1f-af6b-463e98d9a503" (UID: "642cac3d-b299-4d1f-af6b-463e98d9a503"). InnerVolumeSpecName "kube-api-access-df52b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:49.338547 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.338465    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df52b\" (UniqueName: \"kubernetes.io/projected/642cac3d-b299-4d1f-af6b-463e98d9a503-kube-api-access-df52b\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.338547 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.338495    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/642cac3d-b299-4d1f-af6b-463e98d9a503-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.410965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.410858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.559800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.559769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.761563 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.761529    2560 generic.go:356] "Generic (PLEG): container finished" podID="642cac3d-b299-4d1f-af6b-463e98d9a503" containerID="7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4" exitCode=0
Sep 15 21:37:49.761736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.761575    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"
Sep 15 21:37:49.761736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.761608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" event={"ID":"642cac3d-b299-4d1f-af6b-463e98d9a503","Type":"ContainerDied","Data":"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"}
Sep 15 21:37:49.761736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.761659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6" event={"ID":"642cac3d-b299-4d1f-af6b-463e98d9a503","Type":"ContainerDied","Data":"67f12836d1fd7ecb219e894579fe04cf3572869a56183b01564eec71b032d76e"}
Sep 15 21:37:49.761736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.761680    2560 scope.go:117] "RemoveContainer" containerID="7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"
Sep 15 21:37:49.771305 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.771286    2560 scope.go:117] "RemoveContainer" containerID="7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"
Sep 15 21:37:49.771594 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:37:49.771571    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4\": container with ID starting with 7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4 not found: ID does not exist" containerID="7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"
Sep 15 21:37:49.771647 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.771603    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4"} err="failed to get container status \"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4\": rpc error: code = NotFound desc = could not find container \"7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4\": container with ID starting with 7a379b61247f0e45ff7ede0dc23e93f94f13afb59def6af9780aeb75dccb77b4 not found: ID does not exist"
Sep 15 21:37:49.785309 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.785281    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:37:49.789108 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:49.789079    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30e32e-85b4c47f6b-258b6"]
Sep 15 21:37:50.082970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:50.082873    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="642cac3d-b299-4d1f-af6b-463e98d9a503" path="/var/lib/kubelet/pods/642cac3d-b299-4d1f-af6b-463e98d9a503/volumes"
Sep 15 21:37:50.083321 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:50.083250    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f8eead-9384-4731-b19a-cfe9ed478fe4" path="/var/lib/kubelet/pods/a4f8eead-9384-4731-b19a-cfe9ed478fe4/volumes"
Sep 15 21:37:50.425754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:50.425718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:51.195422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:51.195375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:51.908626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:51.908571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:52.807198 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:52.807162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:53.683295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:53.683252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:54.480366 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:54.480332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:55.599736 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:55.599703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:55.700599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:55.700557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:55.888182 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:55.888098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:56.196894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.196810    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"]
Sep 15 21:37:56.197250 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197237    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f8eead-9384-4731-b19a-cfe9ed478fe4" containerName="revoke-keys"
Sep 15 21:37:56.197295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197251    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f8eead-9384-4731-b19a-cfe9ed478fe4" containerName="revoke-keys"
Sep 15 21:37:56.197295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197261    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642cac3d-b299-4d1f-af6b-463e98d9a503" containerName="payload-pre-processing"
Sep 15 21:37:56.197295 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197267    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="642cac3d-b299-4d1f-af6b-463e98d9a503" containerName="payload-pre-processing"
Sep 15 21:37:56.197392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197332    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="642cac3d-b299-4d1f-af6b-463e98d9a503" containerName="payload-pre-processing"
Sep 15 21:37:56.197392 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.197346    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f8eead-9384-4731-b19a-cfe9ed478fe4" containerName="revoke-keys"
Sep 15 21:37:56.201828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.201806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:56.204516 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.204493    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:37:56.205609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.205581    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:37:56.209294 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.209270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"]
Sep 15 21:37:56.303112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.303070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q\" (UID: \"78632da1-6441-4d92-bc0a-90fd1bd66365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:56.307628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.307585    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:56.404427 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.404386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q\" (UID: \"78632da1-6441-4d92-bc0a-90fd1bd66365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:56.405069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.405050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q\" (UID: \"78632da1-6441-4d92-bc0a-90fd1bd66365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:56.514734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.514641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:56.584740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.584697    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:37:56.786170 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.786139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"]
Sep 15 21:37:56.788378 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:37:56.788342    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78632da1_6441_4d92_bc0a_90fd1bd66365.slice/crio-d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc WatchSource:0}: Error finding container d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc: Status 404 returned error can't find the container with id d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc
Sep 15 21:37:56.806876 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:56.806842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q" event={"ID":"78632da1-6441-4d92-bc0a-90fd1bd66365","Type":"ContainerStarted","Data":"d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc"}
Sep 15 21:37:57.085318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:57.085230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:57.816052 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:57.815968    2560 generic.go:356] "Generic (PLEG): container finished" podID="78632da1-6441-4d92-bc0a-90fd1bd66365" containerID="bcd5fad61c8a74dee29c3b5256ee173079dbd517a44ceb283fda5b9328ef36b1" exitCode=0
Sep 15 21:37:57.816052 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:57.816009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q" event={"ID":"78632da1-6441-4d92-bc0a-90fd1bd66365","Type":"ContainerDied","Data":"bcd5fad61c8a74dee29c3b5256ee173079dbd517a44ceb283fda5b9328ef36b1"}
Sep 15 21:37:57.903786 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:57.903750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.827345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:58.827317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.961740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:58.961707    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:59.129131 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.129098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca\") pod \"78632da1-6441-4d92-bc0a-90fd1bd66365\" (UID: \"78632da1-6441-4d92-bc0a-90fd1bd66365\") "
Sep 15 21:37:59.129475 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.129451    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78632da1-6441-4d92-bc0a-90fd1bd66365" (UID: "78632da1-6441-4d92-bc0a-90fd1bd66365"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:59.230600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.230561    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78632da1-6441-4d92-bc0a-90fd1bd66365-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:37:59.691279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.691244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:59.830262 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.830233    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"
Sep 15 21:37:59.830635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.830265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q" event={"ID":"78632da1-6441-4d92-bc0a-90fd1bd66365","Type":"ContainerDied","Data":"d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc"}
Sep 15 21:37:59.830635 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:37:59.830311    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5b805e0e5e63f40b2393258d0c8ebb13630d984b31879fa54a0d2ffbf6739bc"
Sep 15 21:38:00.566779 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:00.566739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:01.280693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:01.280657    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:02.686641 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.686602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:02.783302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.783261    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"]
Sep 15 21:38:02.783689 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.783677    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78632da1-6441-4d92-bc0a-90fd1bd66365" containerName="revoke-keys"
Sep 15 21:38:02.783732 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.783691    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78632da1-6441-4d92-bc0a-90fd1bd66365" containerName="revoke-keys"
Sep 15 21:38:02.783768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.783759    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="78632da1-6441-4d92-bc0a-90fd1bd66365" containerName="revoke-keys"
Sep 15 21:38:02.786838 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.786822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:02.789413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.789391    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:38:02.789413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.789407    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:38:02.795550 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.795523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"]
Sep 15 21:38:02.866016 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.865983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf\" (UID: \"ca8644ab-43ff-4b32-98df-255a177b36c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:02.967413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.967324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf\" (UID: \"ca8644ab-43ff-4b32-98df-255a177b36c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:02.968019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:02.967998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf\" (UID: \"ca8644ab-43ff-4b32-98df-255a177b36c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:03.086785 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.086741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:03.097713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.097685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:03.371340 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.371310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"]
Sep 15 21:38:03.372672 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:38:03.372648    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8644ab_43ff_4b32_98df_255a177b36c5.slice/crio-240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174 WatchSource:0}: Error finding container 240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174: Status 404 returned error can't find the container with id 240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174
Sep 15 21:38:03.854698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.854655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf" event={"ID":"ca8644ab-43ff-4b32-98df-255a177b36c5","Type":"ContainerStarted","Data":"df832ed03db0ee50bd425cca1b9e1f908a75e92f5a29e4a4d53d172a2a30c7aa"}
Sep 15 21:38:03.855103 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.854729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf" event={"ID":"ca8644ab-43ff-4b32-98df-255a177b36c5","Type":"ContainerStarted","Data":"240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174"}
Sep 15 21:38:03.871820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.871767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf" podStartSLOduration=1.871751843 podStartE2EDuration="1.871751843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:38:03.870715251 +0000 UTC m=+1778.275037299" watchObservedRunningTime="2026-09-15 21:38:03.871751843 +0000 UTC m=+1778.276073890"
Sep 15 21:38:03.993110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:03.993026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:04.676823 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:04.676787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:04.861749 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:04.861709    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca8644ab-43ff-4b32-98df-255a177b36c5" containerID="df832ed03db0ee50bd425cca1b9e1f908a75e92f5a29e4a4d53d172a2a30c7aa" exitCode=0
Sep 15 21:38:04.862205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:04.861768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf" event={"ID":"ca8644ab-43ff-4b32-98df-255a177b36c5","Type":"ContainerDied","Data":"df832ed03db0ee50bd425cca1b9e1f908a75e92f5a29e4a4d53d172a2a30c7aa"}
Sep 15 21:38:05.591068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:05.591035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:06.006898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.006874    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:06.096270 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.096238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca\") pod \"ca8644ab-43ff-4b32-98df-255a177b36c5\" (UID: \"ca8644ab-43ff-4b32-98df-255a177b36c5\") "
Sep 15 21:38:06.096725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.096564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca8644ab-43ff-4b32-98df-255a177b36c5" (UID: "ca8644ab-43ff-4b32-98df-255a177b36c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:06.096725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.096640    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca8644ab-43ff-4b32-98df-255a177b36c5-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:06.425207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.425167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:06.875376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.875344    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"
Sep 15 21:38:06.875376 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.875356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf" event={"ID":"ca8644ab-43ff-4b32-98df-255a177b36c5","Type":"ContainerDied","Data":"240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174"}
Sep 15 21:38:06.875628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:06.875436    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="240e0af675a590c14a5bba764184d9a92babb7113fab3d44ef6e58aae8b65174"
Sep 15 21:38:07.394296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:07.394261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:07.670963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:07.670857    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:38:07.685384 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:07.685354    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:38:07.763564 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:07.763526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:08.197892 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.197860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:08.907008 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.906976    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"]
Sep 15 21:38:08.908838 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.908813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:08.909754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.909732    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-a3aa55-29825130-8dsr6"]
Sep 15 21:38:08.933276 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.933242    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:38:08.933529 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.933467    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" podUID="e3096012-9aaf-4c38-add4-5476bacace70" containerName="payload-processing" containerID="cri-o://19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7" gracePeriod=30
Sep 15 21:38:08.942819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.942793    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:38:08.943136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.943098    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" podUID="323d19d1-471f-4607-8c1f-eac8084c2121" containerName="payload-pre-processing" containerID="cri-o://9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750" gracePeriod=30
Sep 15 21:38:08.979169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:08.979130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.078498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.078461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.142219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.142186    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"]
Sep 15 21:38:09.146310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.146277    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-a3aa55-cbd6q"]
Sep 15 21:38:09.149996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.149903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.210451 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.210416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.227223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.227199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:38:09.230316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.230295    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:38:09.328490 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.328456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlf4s\" (UniqueName: \"kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s\") pod \"323d19d1-471f-4607-8c1f-eac8084c2121\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") "
Sep 15 21:38:09.328671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.328519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume\") pod \"323d19d1-471f-4607-8c1f-eac8084c2121\" (UID: \"323d19d1-471f-4607-8c1f-eac8084c2121\") "
Sep 15 21:38:09.328671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.328603    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume\") pod \"e3096012-9aaf-4c38-add4-5476bacace70\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") "
Sep 15 21:38:09.328671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.328642    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmcgl\" (UniqueName: \"kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl\") pod \"e3096012-9aaf-4c38-add4-5476bacace70\" (UID: \"e3096012-9aaf-4c38-add4-5476bacace70\") "
Sep 15 21:38:09.328996 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.328964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "323d19d1-471f-4607-8c1f-eac8084c2121" (UID: "323d19d1-471f-4607-8c1f-eac8084c2121"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:09.329061 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.329019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3096012-9aaf-4c38-add4-5476bacace70" (UID: "e3096012-9aaf-4c38-add4-5476bacace70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:09.330803 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.330773    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s" (OuterVolumeSpecName: "kube-api-access-tlf4s") pod "323d19d1-471f-4607-8c1f-eac8084c2121" (UID: "323d19d1-471f-4607-8c1f-eac8084c2121"). InnerVolumeSpecName "kube-api-access-tlf4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:09.330912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.330878    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl" (OuterVolumeSpecName: "kube-api-access-rmcgl") pod "e3096012-9aaf-4c38-add4-5476bacace70" (UID: "e3096012-9aaf-4c38-add4-5476bacace70"). InnerVolumeSpecName "kube-api-access-rmcgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:09.429660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.429607    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/323d19d1-471f-4607-8c1f-eac8084c2121-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:09.429660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.429654    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3096012-9aaf-4c38-add4-5476bacace70-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:09.429660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.429666    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmcgl\" (UniqueName: \"kubernetes.io/projected/e3096012-9aaf-4c38-add4-5476bacace70-kube-api-access-rmcgl\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:09.429660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.429675    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlf4s\" (UniqueName: \"kubernetes.io/projected/323d19d1-471f-4607-8c1f-eac8084c2121-kube-api-access-tlf4s\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:09.500787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.500694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.606086 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.606042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:09.896033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.896000    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3096012-9aaf-4c38-add4-5476bacace70" containerID="19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7" exitCode=0
Sep 15 21:38:09.896204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.896047    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"
Sep 15 21:38:09.896204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.896086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" event={"ID":"e3096012-9aaf-4c38-add4-5476bacace70","Type":"ContainerDied","Data":"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"}
Sep 15 21:38:09.896204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.896141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v" event={"ID":"e3096012-9aaf-4c38-add4-5476bacace70","Type":"ContainerDied","Data":"6258d83eab3d6e75c7d54ff4dccc4b22d0217f1d97e312f0b6f7603791fa9eab"}
Sep 15 21:38:09.896204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.896173    2560 scope.go:117] "RemoveContainer" containerID="19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"
Sep 15 21:38:09.897629 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.897608    2560 generic.go:356] "Generic (PLEG): container finished" podID="323d19d1-471f-4607-8c1f-eac8084c2121" containerID="9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750" exitCode=0
Sep 15 21:38:09.897753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.897638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" event={"ID":"323d19d1-471f-4607-8c1f-eac8084c2121","Type":"ContainerDied","Data":"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"}
Sep 15 21:38:09.897753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.897662    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"
Sep 15 21:38:09.897753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.897704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q" event={"ID":"323d19d1-471f-4607-8c1f-eac8084c2121","Type":"ContainerDied","Data":"33ce487c91e26573b64c2ed9ab86a61bb01a14f4975cb1e1c9ee51d99e8c0fbb"}
Sep 15 21:38:09.906015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.905998    2560 scope.go:117] "RemoveContainer" containerID="19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"
Sep 15 21:38:09.906335 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:09.906301    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7\": container with ID starting with 19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7 not found: ID does not exist" containerID="19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"
Sep 15 21:38:09.906444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.906334    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7"} err="failed to get container status \"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7\": rpc error: code = NotFound desc = could not find container \"19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7\": container with ID starting with 19d0b02f7495cd22a7940c4d0eb74655589bad46cad9a2fdebdaf8e8db3d6db7 not found: ID does not exist"
Sep 15 21:38:09.906444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.906357    2560 scope.go:117] "RemoveContainer" containerID="9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"
Sep 15 21:38:09.915296 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.915273    2560 scope.go:117] "RemoveContainer" containerID="9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"
Sep 15 21:38:09.915659 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:09.915640    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750\": container with ID starting with 9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750 not found: ID does not exist" containerID="9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"
Sep 15 21:38:09.915706 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.915668    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750"} err="failed to get container status \"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750\": rpc error: code = NotFound desc = could not find container \"9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750\": container with ID starting with 9c55ce0f908a501b6b303d28732a7e75b458647c8b174ae704ca97ad12b6d750 not found: ID does not exist"
Sep 15 21:38:09.922951 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.922911    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:38:09.926859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.926836    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3aa55-7c7d754dfd-5cs4q"]
Sep 15 21:38:09.937555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.937528    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:38:09.944356 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:09.944332    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-a3aa55-75fc87ccf7-59l8v"]
Sep 15 21:38:10.082984 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:10.082930    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323d19d1-471f-4607-8c1f-eac8084c2121" path="/var/lib/kubelet/pods/323d19d1-471f-4607-8c1f-eac8084c2121/volumes"
Sep 15 21:38:10.083271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:10.083258    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e05558-e103-4b29-9e39-b2ab0c143bad" path="/var/lib/kubelet/pods/45e05558-e103-4b29-9e39-b2ab0c143bad/volumes"
Sep 15 21:38:10.083612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:10.083595    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78632da1-6441-4d92-bc0a-90fd1bd66365" path="/var/lib/kubelet/pods/78632da1-6441-4d92-bc0a-90fd1bd66365/volumes"
Sep 15 21:38:10.084104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:10.084085    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3096012-9aaf-4c38-add4-5476bacace70" path="/var/lib/kubelet/pods/e3096012-9aaf-4c38-add4-5476bacace70/volumes"
Sep 15 21:38:10.378323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:10.378288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:11.205147 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:11.205112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:11.970602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:11.970568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:12.683324 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:12.683289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:15.747620 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:15.747588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:15.847987 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:15.847924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:15.980069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:15.980035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:16.296895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.296862    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"]
Sep 15 21:38:16.297279 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297266    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3096012-9aaf-4c38-add4-5476bacace70" containerName="payload-processing"
Sep 15 21:38:16.297344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297280    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3096012-9aaf-4c38-add4-5476bacace70" containerName="payload-processing"
Sep 15 21:38:16.297344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297299    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8644ab-43ff-4b32-98df-255a177b36c5" containerName="revoke-keys"
Sep 15 21:38:16.297344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297305    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8644ab-43ff-4b32-98df-255a177b36c5" containerName="revoke-keys"
Sep 15 21:38:16.297344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297313    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323d19d1-471f-4607-8c1f-eac8084c2121" containerName="payload-pre-processing"
Sep 15 21:38:16.297344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297318    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="323d19d1-471f-4607-8c1f-eac8084c2121" containerName="payload-pre-processing"
Sep 15 21:38:16.297505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297379    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="323d19d1-471f-4607-8c1f-eac8084c2121" containerName="payload-pre-processing"
Sep 15 21:38:16.297505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297387    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3096012-9aaf-4c38-add4-5476bacace70" containerName="payload-processing"
Sep 15 21:38:16.297505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.297397    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8644ab-43ff-4b32-98df-255a177b36c5" containerName="revoke-keys"
Sep 15 21:38:16.302038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.302018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:16.304335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.304304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:38:16.304473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.304343    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:38:16.308862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.308833    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"]
Sep 15 21:38:16.399477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.399432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn\" (UID: \"083a1ef7-c03b-4deb-a007-fd499e93fd76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:16.501118 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.501058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn\" (UID: \"083a1ef7-c03b-4deb-a007-fd499e93fd76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:16.501701 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.501678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn\" (UID: \"083a1ef7-c03b-4deb-a007-fd499e93fd76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:16.554137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.554040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:16.614501 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.614470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:16.891519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.891491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"]
Sep 15 21:38:16.893835 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:38:16.893806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a1ef7_c03b_4deb_a007_fd499e93fd76.slice/crio-5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47 WatchSource:0}: Error finding container 5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47: Status 404 returned error can't find the container with id 5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47
Sep 15 21:38:16.946852 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:16.946822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn" event={"ID":"083a1ef7-c03b-4deb-a007-fd499e93fd76","Type":"ContainerStarted","Data":"5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47"}
Sep 15 21:38:17.475290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:17.475182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:17.954884 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:17.954850    2560 generic.go:356] "Generic (PLEG): container finished" podID="083a1ef7-c03b-4deb-a007-fd499e93fd76" containerID="075b5fb523a1e3471e7ce26925766c1c757daeea3e1603d689d3a06bd76b3b5f" exitCode=0
Sep 15 21:38:17.955271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:17.954963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn" event={"ID":"083a1ef7-c03b-4deb-a007-fd499e93fd76","Type":"ContainerDied","Data":"075b5fb523a1e3471e7ce26925766c1c757daeea3e1603d689d3a06bd76b3b5f"}
Sep 15 21:38:18.213742 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:18.213624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:18.843217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:18.843167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:18.881754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:18.881713    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:38:18.882006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:18.881973    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" podUID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" containerName="payload-pre-processing" containerID="cri-o://9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b" gracePeriod=30
Sep 15 21:38:18.942634 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:18.942594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.043871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.043826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.113373 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.113345    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:19.134390 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.134350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.152809 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.152778    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:38:19.197126 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.197092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.225858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.225827    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"]
Sep 15 21:38:19.227748 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.227724    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbxl\" (UniqueName: \"kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl\") pod \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") "
Sep 15 21:38:19.227882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.227794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca\") pod \"083a1ef7-c03b-4deb-a007-fd499e93fd76\" (UID: \"083a1ef7-c03b-4deb-a007-fd499e93fd76\") "
Sep 15 21:38:19.227962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.227885    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume\") pod \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\" (UID: \"485bbce7-cf9c-4b32-840f-fff5b8ecbc12\") "
Sep 15 21:38:19.228679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.228178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "083a1ef7-c03b-4deb-a007-fd499e93fd76" (UID: "083a1ef7-c03b-4deb-a007-fd499e93fd76"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:19.228679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.228302    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "485bbce7-cf9c-4b32-840f-fff5b8ecbc12" (UID: "485bbce7-cf9c-4b32-840f-fff5b8ecbc12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:19.228679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.228663    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083a1ef7-c03b-4deb-a007-fd499e93fd76-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:19.228679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.228684    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:19.229130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.229112    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-625609-7ffnf"]
Sep 15 21:38:19.230466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.230448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl" (OuterVolumeSpecName: "kube-api-access-tmbxl") pod "485bbce7-cf9c-4b32-840f-fff5b8ecbc12" (UID: "485bbce7-cf9c-4b32-840f-fff5b8ecbc12"). InnerVolumeSpecName "kube-api-access-tmbxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:19.329539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.329504    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbxl\" (UniqueName: \"kubernetes.io/projected/485bbce7-cf9c-4b32-840f-fff5b8ecbc12-kube-api-access-tmbxl\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:19.366519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.366483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.490458 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.490426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:19.968573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.968537    2560 generic.go:356] "Generic (PLEG): container finished" podID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" containerID="9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b" exitCode=0
Sep 15 21:38:19.968734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.968584    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"
Sep 15 21:38:19.968734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.968608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" event={"ID":"485bbce7-cf9c-4b32-840f-fff5b8ecbc12","Type":"ContainerDied","Data":"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"}
Sep 15 21:38:19.968734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.968661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn" event={"ID":"485bbce7-cf9c-4b32-840f-fff5b8ecbc12","Type":"ContainerDied","Data":"396a0e7e17356c4f55bc4241c1830755b5fc759a1433f75ad74e9217821cfbaf"}
Sep 15 21:38:19.968734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.968695    2560 scope.go:117] "RemoveContainer" containerID="9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"
Sep 15 21:38:19.970110 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.970092    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"
Sep 15 21:38:19.970193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.970088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn" event={"ID":"083a1ef7-c03b-4deb-a007-fd499e93fd76","Type":"ContainerDied","Data":"5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47"}
Sep 15 21:38:19.970252 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.970213    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5368d02889a2095ea53970b7daa87d9f8bfefb9a44a110d69cfcb1ee91cdfd47"
Sep 15 21:38:19.980035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.980012    2560 scope.go:117] "RemoveContainer" containerID="9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"
Sep 15 21:38:19.980428 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:19.980404    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b\": container with ID starting with 9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b not found: ID does not exist" containerID="9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"
Sep 15 21:38:19.980524 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:19.980436    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b"} err="failed to get container status \"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b\": rpc error: code = NotFound desc = could not find container \"9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b\": container with ID starting with 9f01bd1729b95145a447eb63efb2d7ebc49de335d5aa9822d39d407a10db353b not found: ID does not exist"
Sep 15 21:38:20.000127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:20.000096    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:38:20.004171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:20.004144    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-625609-7cbb5bdccd-k5lnn"]
Sep 15 21:38:20.082096 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:20.082055    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" path="/var/lib/kubelet/pods/485bbce7-cf9c-4b32-840f-fff5b8ecbc12/volumes"
Sep 15 21:38:20.082585 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:20.082552    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8644ab-43ff-4b32-98df-255a177b36c5" path="/var/lib/kubelet/pods/ca8644ab-43ff-4b32-98df-255a177b36c5/volumes"
Sep 15 21:38:20.179294 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:20.179185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:21.118102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:21.118064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:22.001394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.001362    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:22.690780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.690719    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" podUID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" containerName="main" containerID="cri-o://36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade" gracePeriod=45
Sep 15 21:38:22.704641 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.704584    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" podUID="6b020730-d895-41ee-ad41-c48c3ad51371" containerName="main" containerID="cri-o://34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657" gracePeriod=45
Sep 15 21:38:22.872077 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.872044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:38:22.960596 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.960569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:22.981813 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.981791    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:38:22.984552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.984525    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:38:22.991510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.991487    2560 generic.go:356] "Generic (PLEG): container finished" podID="6b020730-d895-41ee-ad41-c48c3ad51371" containerID="34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657" exitCode=0
Sep 15 21:38:22.991604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.991522    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"
Sep 15 21:38:22.991604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.991571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" event={"ID":"6b020730-d895-41ee-ad41-c48c3ad51371","Type":"ContainerDied","Data":"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"}
Sep 15 21:38:22.991713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.991611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r" event={"ID":"6b020730-d895-41ee-ad41-c48c3ad51371","Type":"ContainerDied","Data":"5bcd22b061e0a0df9de990c2a206c0ae79daa4703d409c7de686d9284cd0f599"}
Sep 15 21:38:22.991713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.991632    2560 scope.go:117] "RemoveContainer" containerID="34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"
Sep 15 21:38:22.992963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.992928    2560 generic.go:356] "Generic (PLEG): container finished" podID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" containerID="36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade" exitCode=0
Sep 15 21:38:22.993069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.992975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" event={"ID":"5a9bd806-6985-4ac1-adcd-c6946c2acf23","Type":"ContainerDied","Data":"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"}
Sep 15 21:38:22.993069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.993019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq" event={"ID":"5a9bd806-6985-4ac1-adcd-c6946c2acf23","Type":"ContainerDied","Data":"f1db12b7d4973a0c547ad801b2ac9c46c76f1041393c0e64ff0d1cf75448c184"}
Sep 15 21:38:22.993069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:22.992986    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"
Sep 15 21:38:23.000643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.000627    2560 scope.go:117] "RemoveContainer" containerID="34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"
Sep 15 21:38:23.000921 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:23.000892    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657\": container with ID starting with 34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657 not found: ID does not exist" containerID="34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"
Sep 15 21:38:23.001022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.000920    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657"} err="failed to get container status \"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657\": rpc error: code = NotFound desc = could not find container \"34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657\": container with ID starting with 34dfe10b28bcf89d323de910de89bbbc40eae2130797bbad1681e5a8cfa44657 not found: ID does not exist"
Sep 15 21:38:23.001022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.000968    2560 scope.go:117] "RemoveContainer" containerID="36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"
Sep 15 21:38:23.010542 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.010518    2560 scope.go:117] "RemoveContainer" containerID="36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"
Sep 15 21:38:23.010891 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:23.010866    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade\": container with ID starting with 36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade not found: ID does not exist" containerID="36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"
Sep 15 21:38:23.011024 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.010901    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade"} err="failed to get container status \"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade\": rpc error: code = NotFound desc = could not find container \"36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade\": container with ID starting with 36f43ead7eb9b3ec76da8ba0b82a8baaab19ab4707835e9555dbf7650cd7eade not found: ID does not exist"
Sep 15 21:38:23.064555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.064755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064571    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.064755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.064755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.064755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.064755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc96j\" (UniqueName: \"kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm\") pod \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\" (UID: \"5a9bd806-6985-4ac1-adcd-c6946c2acf23\") "
Sep 15 21:38:23.065054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.064923    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.065370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmmzt\" (UniqueName: \"kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt\") pod \"6b020730-d895-41ee-ad41-c48c3ad51371\" (UID: \"6b020730-d895-41ee-ad41-c48c3ad51371\") "
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065827    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065848    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home" (OuterVolumeSpecName: "home") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.065886 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.065722    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home" (OuterVolumeSpecName: "home") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.067760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.067730    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:38:23.068045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.067929    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm" (OuterVolumeSpecName: "dshm") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.068045 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.068008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:38:23.068461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.068440    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm" (OuterVolumeSpecName: "dshm") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:23.068687 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.068668    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j" (OuterVolumeSpecName: "kube-api-access-pc96j") pod "5a9bd806-6985-4ac1-adcd-c6946c2acf23" (UID: "5a9bd806-6985-4ac1-adcd-c6946c2acf23"). InnerVolumeSpecName "kube-api-access-pc96j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:23.069617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.069597    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt" (OuterVolumeSpecName: "kube-api-access-kmmzt") pod "6b020730-d895-41ee-ad41-c48c3ad51371" (UID: "6b020730-d895-41ee-ad41-c48c3ad51371"). InnerVolumeSpecName "kube-api-access-kmmzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:23.167070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167026    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmmzt\" (UniqueName: \"kubernetes.io/projected/6b020730-d895-41ee-ad41-c48c3ad51371-kube-api-access-kmmzt\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167060    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167075    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167085    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b020730-d895-41ee-ad41-c48c3ad51371-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167096    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167107    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9bd806-6985-4ac1-adcd-c6946c2acf23-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167117    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc96j\" (UniqueName: \"kubernetes.io/projected/5a9bd806-6985-4ac1-adcd-c6946c2acf23-kube-api-access-pc96j\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167128    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b020730-d895-41ee-ad41-c48c3ad51371-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167138    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.167369 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.167150    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a9bd806-6985-4ac1-adcd-c6946c2acf23-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:23.317977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.317921    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:38:23.322240 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.322206    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-625609/distinct-2-w4-625609-kserve-75bffd9fb8-vp9jq"]
Sep 15 21:38:23.335513 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.335478    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:38:23.340719 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:23.340686    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-625609/premium-w4-625609-kserve-7688647db4-5ph4r"]
Sep 15 21:38:24.082631 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:24.082590    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" path="/var/lib/kubelet/pods/5a9bd806-6985-4ac1-adcd-c6946c2acf23/volumes"
Sep 15 21:38:24.083207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:24.083186    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b020730-d895-41ee-ad41-c48c3ad51371" path="/var/lib/kubelet/pods/6b020730-d895-41ee-ad41-c48c3ad51371/volumes"
Sep 15 21:38:25.430142 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:25.430097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:25.498459 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:25.498419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:25.688019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:25.687919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:26.239085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:26.239059    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:38:26.242522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:26.242498    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:38:26.493003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:26.492888    2560 scope.go:117] "RemoveContainer" containerID="4d245da394f59492ed8942ed7d5b0825570aaf061af64857dacc8f63daa80d24"
Sep 15 21:38:26.585679 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:26.585648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.227595 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.227563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.258695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.258655    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:38:27.258948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.258901    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" podUID="1a547154-6dab-4d13-b0b8-0f61e964cdff" containerName="payload-processing" containerID="cri-o://5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929" gracePeriod=30
Sep 15 21:38:27.265468 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.265435    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:38:27.265923 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.265739    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" podUID="a8ddfee4-1964-49ef-a870-b383d10722eb" containerName="payload-pre-processing" containerID="cri-o://f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5" gracePeriod=30
Sep 15 21:38:27.306236 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.306202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.372609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.372578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.448036 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.447972    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"]
Sep 15 21:38:27.450583 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.450547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.450963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.450927    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9aeead-8trsn"]
Sep 15 21:38:27.511275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.511247    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:38:27.515345 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.515315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.544228 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.544200    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:38:27.611756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.611719    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume\") pod \"1a547154-6dab-4d13-b0b8-0f61e964cdff\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") "
Sep 15 21:38:27.611975 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.611784    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6bkp\" (UniqueName: \"kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp\") pod \"1a547154-6dab-4d13-b0b8-0f61e964cdff\" (UID: \"1a547154-6dab-4d13-b0b8-0f61e964cdff\") "
Sep 15 21:38:27.612241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.612216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a547154-6dab-4d13-b0b8-0f61e964cdff" (UID: "1a547154-6dab-4d13-b0b8-0f61e964cdff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:27.613973 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.613931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp" (OuterVolumeSpecName: "kube-api-access-h6bkp") pod "1a547154-6dab-4d13-b0b8-0f61e964cdff" (UID: "1a547154-6dab-4d13-b0b8-0f61e964cdff"). InnerVolumeSpecName "kube-api-access-h6bkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:27.712808 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.712767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw2mt\" (UniqueName: \"kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt\") pod \"a8ddfee4-1964-49ef-a870-b383d10722eb\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") "
Sep 15 21:38:27.713031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.712824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume\") pod \"a8ddfee4-1964-49ef-a870-b383d10722eb\" (UID: \"a8ddfee4-1964-49ef-a870-b383d10722eb\") "
Sep 15 21:38:27.713031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.712996    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6bkp\" (UniqueName: \"kubernetes.io/projected/1a547154-6dab-4d13-b0b8-0f61e964cdff-kube-api-access-h6bkp\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:27.713031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.713013    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a547154-6dab-4d13-b0b8-0f61e964cdff-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:27.713317 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.713288    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8ddfee4-1964-49ef-a870-b383d10722eb" (UID: "a8ddfee4-1964-49ef-a870-b383d10722eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:27.714893 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.714870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt" (OuterVolumeSpecName: "kube-api-access-kw2mt") pod "a8ddfee4-1964-49ef-a870-b383d10722eb" (UID: "a8ddfee4-1964-49ef-a870-b383d10722eb"). InnerVolumeSpecName "kube-api-access-kw2mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:27.797597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.797500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:27.813800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.813758    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw2mt\" (UniqueName: \"kubernetes.io/projected/a8ddfee4-1964-49ef-a870-b383d10722eb-kube-api-access-kw2mt\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:27.813800 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.813800    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8ddfee4-1964-49ef-a870-b383d10722eb-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:27.899009 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:27.898971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:28.032208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.032169    2560 generic.go:356] "Generic (PLEG): container finished" podID="1a547154-6dab-4d13-b0b8-0f61e964cdff" containerID="5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929" exitCode=0
Sep 15 21:38:28.032382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.032234    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"
Sep 15 21:38:28.032382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.032253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" event={"ID":"1a547154-6dab-4d13-b0b8-0f61e964cdff","Type":"ContainerDied","Data":"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"}
Sep 15 21:38:28.032382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.032343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk" event={"ID":"1a547154-6dab-4d13-b0b8-0f61e964cdff","Type":"ContainerDied","Data":"0ef2b2aa7e5b7464d4c28b7690b5ab112b52a6cd7b8bdfa8788770635c93d563"}
Sep 15 21:38:28.032382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.032375    2560 scope.go:117] "RemoveContainer" containerID="5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"
Sep 15 21:38:28.033764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.033740    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8ddfee4-1964-49ef-a870-b383d10722eb" containerID="f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5" exitCode=0
Sep 15 21:38:28.033868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.033776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" event={"ID":"a8ddfee4-1964-49ef-a870-b383d10722eb","Type":"ContainerDied","Data":"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"}
Sep 15 21:38:28.033868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.033849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t" event={"ID":"a8ddfee4-1964-49ef-a870-b383d10722eb","Type":"ContainerDied","Data":"4e1fcdd9c1ac3daa41e156d0dc94f5e23ec38398222fa4e4228f592e4435a724"}
Sep 15 21:38:28.033978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.033803    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"
Sep 15 21:38:28.042072 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.042054    2560 scope.go:117] "RemoveContainer" containerID="5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"
Sep 15 21:38:28.042510 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:28.042484    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929\": container with ID starting with 5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929 not found: ID does not exist" containerID="5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"
Sep 15 21:38:28.042597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.042519    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929"} err="failed to get container status \"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929\": rpc error: code = NotFound desc = could not find container \"5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929\": container with ID starting with 5a0c60b4135a18a92151711b45df7d0316e4e8f1774ade8d329d473c7dcfa929 not found: ID does not exist"
Sep 15 21:38:28.042597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.042543    2560 scope.go:117] "RemoveContainer" containerID="f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"
Sep 15 21:38:28.051349 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.051317    2560 scope.go:117] "RemoveContainer" containerID="f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"
Sep 15 21:38:28.051631 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:28.051613    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5\": container with ID starting with f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5 not found: ID does not exist" containerID="f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"
Sep 15 21:38:28.051691 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.051637    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5"} err="failed to get container status \"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5\": rpc error: code = NotFound desc = could not find container \"f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5\": container with ID starting with f1f770cd772271035168332ac2b7c0a035cb794d091d5dfe96bd7bc02bf1d9f5 not found: ID does not exist"
Sep 15 21:38:28.059623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.059596    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:38:28.065393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.065364    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9aeead-567897f789-mqpkk"]
Sep 15 21:38:28.082613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.082581    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083a1ef7-c03b-4deb-a007-fd499e93fd76" path="/var/lib/kubelet/pods/083a1ef7-c03b-4deb-a007-fd499e93fd76/volumes"
Sep 15 21:38:28.083048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.083032    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a547154-6dab-4d13-b0b8-0f61e964cdff" path="/var/lib/kubelet/pods/1a547154-6dab-4d13-b0b8-0f61e964cdff/volumes"
Sep 15 21:38:28.084724 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.084697    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:38:28.089265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.089236    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9aeead-84cd799854-bwx5t"]
Sep 15 21:38:28.611526 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:28.611491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:29.492496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:29.492458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:30.082012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:30.081974    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8ddfee4-1964-49ef-a870-b383d10722eb" path="/var/lib/kubelet/pods/a8ddfee4-1964-49ef-a870-b383d10722eb/volumes"
Sep 15 21:38:33.795432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:33.795385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:33.895461 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:33.895426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:34.039190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:34.039150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:38.412440 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.412398    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-3db23c"]
Sep 15 21:38:38.412966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.412922    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a547154-6dab-4d13-b0b8-0f61e964cdff" containerName="payload-processing"
Sep 15 21:38:38.412966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.412962    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a547154-6dab-4d13-b0b8-0f61e964cdff" containerName="payload-processing"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.412976    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" containerName="main"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.412984    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" containerName="main"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413008    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ddfee4-1964-49ef-a870-b383d10722eb" containerName="payload-pre-processing"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413017    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ddfee4-1964-49ef-a870-b383d10722eb" containerName="payload-pre-processing"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413039    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" containerName="payload-pre-processing"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413047    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" containerName="payload-pre-processing"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413057    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="083a1ef7-c03b-4deb-a007-fd499e93fd76" containerName="revoke-keys"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413064    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="083a1ef7-c03b-4deb-a007-fd499e93fd76" containerName="revoke-keys"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413075    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b020730-d895-41ee-ad41-c48c3ad51371" containerName="main"
Sep 15 21:38:38.413112 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413083    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b020730-d895-41ee-ad41-c48c3ad51371" containerName="main"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413188    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="485bbce7-cf9c-4b32-840f-fff5b8ecbc12" containerName="payload-pre-processing"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413202    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b020730-d895-41ee-ad41-c48c3ad51371" containerName="main"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413209    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9bd806-6985-4ac1-adcd-c6946c2acf23" containerName="main"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413218    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a547154-6dab-4d13-b0b8-0f61e964cdff" containerName="payload-processing"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413227    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="083a1ef7-c03b-4deb-a007-fd499e93fd76" containerName="revoke-keys"
Sep 15 21:38:38.413586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.413240    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ddfee4-1964-49ef-a870-b383d10722eb" containerName="payload-pre-processing"
Sep 15 21:38:38.417219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.417197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:38.420794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.420767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mbx7k\""
Sep 15 21:38:38.421926 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.421903    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-3db23c"]
Sep 15 21:38:38.509298 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.509257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5xvl\" (UniqueName: \"kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl\") pod \"test-curl-7448-3db23c\" (UID: \"711c7364-3ed3-48c4-8599-e6aca0d8fd3a\") " pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:38.610586 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.610543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xvl\" (UniqueName: \"kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl\") pod \"test-curl-7448-3db23c\" (UID: \"711c7364-3ed3-48c4-8599-e6aca0d8fd3a\") " pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:38.618713 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.618686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5xvl\" (UniqueName: \"kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl\") pod \"test-curl-7448-3db23c\" (UID: \"711c7364-3ed3-48c4-8599-e6aca0d8fd3a\") " pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:38.727880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.727791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:38.999752 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:38.999726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-3db23c"]
Sep 15 21:38:39.001873 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:38:39.001849    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod711c7364_3ed3_48c4_8599_e6aca0d8fd3a.slice/crio-dc79217303a5b8cf3ea55942167922a832dd779906f9ee81a5309f8962a4737a WatchSource:0}: Error finding container dc79217303a5b8cf3ea55942167922a832dd779906f9ee81a5309f8962a4737a: Status 404 returned error can't find the container with id dc79217303a5b8cf3ea55942167922a832dd779906f9ee81a5309f8962a4737a
Sep 15 21:38:39.098165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:39.098126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-3db23c" event={"ID":"711c7364-3ed3-48c4-8599-e6aca0d8fd3a","Type":"ContainerStarted","Data":"f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b"}
Sep 15 21:38:39.098327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:39.098187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-3db23c" event={"ID":"711c7364-3ed3-48c4-8599-e6aca0d8fd3a","Type":"ContainerStarted","Data":"dc79217303a5b8cf3ea55942167922a832dd779906f9ee81a5309f8962a4737a"}
Sep 15 21:38:39.122863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:39.122812    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7448-3db23c" podStartSLOduration=1.122794789 podStartE2EDuration="1.122794789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:38:39.120776026 +0000 UTC m=+1813.525098073" watchObservedRunningTime="2026-09-15 21:38:39.122794789 +0000 UTC m=+1813.527116835"
Sep 15 21:38:39.708698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:39.708664    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-3db23c"]
Sep 15 21:38:39.717065 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:39.717027    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-3db23c"]
Sep 15 21:38:40.103483 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:40.103452    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7448-3db23c" container="test-curl-7448-3db23c"
Sep 15 21:38:41.109756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:41.109704    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7448-3db23c" podUID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" containerName="test-curl-7448-3db23c" containerID="cri-o://f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b" gracePeriod=2
Sep 15 21:38:41.161600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:41.161566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:41.650674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:41.650633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:38:42.208013 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:42.207976    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:38:42.538288 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:42.538193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:43.290926 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:43.290894    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:43.358781 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:43.358746    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5xvl\" (UniqueName: \"kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl\") pod \"711c7364-3ed3-48c4-8599-e6aca0d8fd3a\" (UID: \"711c7364-3ed3-48c4-8599-e6aca0d8fd3a\") "
Sep 15 21:38:43.360981 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:43.360931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl" (OuterVolumeSpecName: "kube-api-access-x5xvl") pod "711c7364-3ed3-48c4-8599-e6aca0d8fd3a" (UID: "711c7364-3ed3-48c4-8599-e6aca0d8fd3a"). InnerVolumeSpecName "kube-api-access-x5xvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:43.459997 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:43.459958    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5xvl\" (UniqueName: \"kubernetes.io/projected/711c7364-3ed3-48c4-8599-e6aca0d8fd3a-kube-api-access-x5xvl\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.082657 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.082623    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" path="/var/lib/kubelet/pods/711c7364-3ed3-48c4-8599-e6aca0d8fd3a/volumes"
Sep 15 21:38:44.130003 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.129970    2560 generic.go:356] "Generic (PLEG): container finished" podID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" containerID="f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b" exitCode=137
Sep 15 21:38:44.130165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.130014    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-3db23c"
Sep 15 21:38:44.130165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.130053    2560 scope.go:117] "RemoveContainer" containerID="f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b"
Sep 15 21:38:44.138866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.138833    2560 scope.go:117] "RemoveContainer" containerID="f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b"
Sep 15 21:38:44.139164 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:44.139145    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b\": container with ID starting with f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b not found: ID does not exist" containerID="f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b"
Sep 15 21:38:44.139233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.139172    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b"} err="failed to get container status \"f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b\": rpc error: code = NotFound desc = could not find container \"f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b\": container with ID starting with f87688d1fbbd864dbc950b925052bff7130a9195e7dba500aec97070ecd8cf9b not found: ID does not exist"
Sep 15 21:38:44.304400 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.304361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:44.406417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:44.406375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:45.453071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:45.453035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:49.637740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.637701    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:38:49.638191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.638150    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" containerName="test-curl-7448-3db23c"
Sep 15 21:38:49.638191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.638165    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" containerName="test-curl-7448-3db23c"
Sep 15 21:38:49.638303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.638225    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="711c7364-3ed3-48c4-8599-e6aca0d8fd3a" containerName="test-curl-7448-3db23c"
Sep 15 21:38:49.642862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.642841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.645389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.645371    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"sub-test-model-3c4dc8-kserve-self-signed-certs\""
Sep 15 21:38:49.646246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.646228    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"kube-root-ca.crt\""
Sep 15 21:38:49.646323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.646230    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"openshift-service-ca.crt\""
Sep 15 21:38:49.646718 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.646697    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"default-dockercfg-8r4z7\""
Sep 15 21:38:49.650290 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.650225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:38:49.724599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.724599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.724842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.724842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pltp4\" (UniqueName: \"kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.724842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.724842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.724774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.815164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.815116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:49.825287 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825408 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pltp4\" (UniqueName: \"kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825703 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825837 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825771    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.825893 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.825848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.827650 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.827625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.827824 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.827807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.837069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.837049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pltp4\" (UniqueName: \"kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4\") pod \"sub-test-model-3c4dc8-kserve-849cd75485-wb8qz\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:49.953336 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:49.953240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:50.225168 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:50.225137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:38:50.226991 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:38:50.226960    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdf97fc1_3deb_45ac_a0c5_26dc9ef2ab67.slice/crio-7fd83934b3405a0aa8c6925ecb271d7e9c4fee4867c00b430d173b0b84965d51 WatchSource:0}: Error finding container 7fd83934b3405a0aa8c6925ecb271d7e9c4fee4867c00b430d173b0b84965d51: Status 404 returned error can't find the container with id 7fd83934b3405a0aa8c6925ecb271d7e9c4fee4867c00b430d173b0b84965d51
Sep 15 21:38:51.170292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:51.170259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" event={"ID":"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67","Type":"ContainerStarted","Data":"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"}
Sep 15 21:38:51.170292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:51.170296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" event={"ID":"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67","Type":"ContainerStarted","Data":"7fd83934b3405a0aa8c6925ecb271d7e9c4fee4867c00b430d173b0b84965d51"}
Sep 15 21:38:51.189437 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:51.189385    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" podStartSLOduration=2.189367455 podStartE2EDuration="2.189367455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:38:51.186842367 +0000 UTC m=+1825.591164414" watchObservedRunningTime="2026-09-15 21:38:51.189367455 +0000 UTC m=+1825.593689501"
Sep 15 21:38:53.351372 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:53.351323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:38:57.227298 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.227180    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" podUID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" containerName="main" containerID="cri-o://b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4" gracePeriod=45
Sep 15 21:38:57.474762 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.474735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:38:57.599706 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.599859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2x8g\" (UniqueName: \"kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.599859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599828    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.599980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599875    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.599980 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.600100 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.599979    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs\") pod \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\" (UID: \"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5\") "
Sep 15 21:38:57.600100 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600026    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home" (OuterVolumeSpecName: "home") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:57.600206 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:57.600264 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:57.600322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600307    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:57.600364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600327    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:57.600364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.600339    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:57.602140 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.602117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm" (OuterVolumeSpecName: "dshm") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:57.602223 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.602156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g" (OuterVolumeSpecName: "kube-api-access-h2x8g") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "kube-api-access-h2x8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:57.602265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.602219    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" (UID: "2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:38:57.701179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.701141    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:57.701179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.701173    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:57.701179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:57.701185    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2x8g\" (UniqueName: \"kubernetes.io/projected/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5-kube-api-access-h2x8g\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:38:58.214235 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.214198    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" containerID="b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4" exitCode=0
Sep 15 21:38:58.214414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.214243    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"
Sep 15 21:38:58.214414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.214248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" event={"ID":"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5","Type":"ContainerDied","Data":"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"}
Sep 15 21:38:58.214414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.214362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4" event={"ID":"2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5","Type":"ContainerDied","Data":"9d3a6c3779b897ae30ef0f87558cba5b54c2aa8cd8944f4074be49fa1a623cf8"}
Sep 15 21:38:58.214414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.214388    2560 scope.go:117] "RemoveContainer" containerID="b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"
Sep 15 21:38:58.224592 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.224575    2560 scope.go:117] "RemoveContainer" containerID="b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"
Sep 15 21:38:58.224905 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:38:58.224880    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4\": container with ID starting with b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4 not found: ID does not exist" containerID="b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"
Sep 15 21:38:58.225163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.224910    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4"} err="failed to get container status \"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4\": rpc error: code = NotFound desc = could not find container \"b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4\": container with ID starting with b3fcaee2b5cafee740968f4cbb0acb1cc79b61193a16e91330ef35502b8b45c4 not found: ID does not exist"
Sep 15 21:38:58.230620 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.230592    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:38:58.236344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:58.236317    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/auth-test-model-7c57b6-kserve-596d4f647f-mwcd4"]
Sep 15 21:38:59.695909 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:59.695873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:59.954079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:59.953988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:59.954079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:59.954044    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:38:59.966559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:38:59.966532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:39:00.089560 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:00.089513    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" path="/var/lib/kubelet/pods/2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5/volumes"
Sep 15 21:39:00.237664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:00.237576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:39:17.273580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:17.273542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:17.368865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:17.368815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:18.278580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:18.278545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:22.050078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:22.050030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:39:45.555832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:39:45.555792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:40:00.654391 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:00.654351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:40:01.659888 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:01.659848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:40:01.707302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:01.707259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:02.674129 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:02.674093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:03.745862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:03.745827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:03.805069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:03.805029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:10.760104 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:10.760070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:40:16.679411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:16.679366    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" podUID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" containerName="main" containerID="cri-o://2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe" gracePeriod=45
Sep 15 21:40:16.935743 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:16.935681    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:40:17.032964 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.032894    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033001    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pltp4\" (UniqueName: \"kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033172    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033228    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir\") pod \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\" (UID: \"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67\") "
Sep 15 21:40:17.033285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home" (OuterVolumeSpecName: "home") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:40:17.033519 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:40:17.033580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:40:17.033580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.033503    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.035442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.035408    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm" (OuterVolumeSpecName: "dshm") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:40:17.035442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.035420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4" (OuterVolumeSpecName: "kube-api-access-pltp4") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "kube-api-access-pltp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:40:17.035582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.035495    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" (UID: "bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:40:17.134211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.134170    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.134211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.134203    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.134211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.134211    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.134211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.134219    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pltp4\" (UniqueName: \"kubernetes.io/projected/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-kube-api-access-pltp4\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.134497 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.134230    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:40:17.684215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.684179    2560 generic.go:356] "Generic (PLEG): container finished" podID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" containerID="2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe" exitCode=0
Sep 15 21:40:17.684604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.684219    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"
Sep 15 21:40:17.684604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.684252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" event={"ID":"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67","Type":"ContainerDied","Data":"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"}
Sep 15 21:40:17.684604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.684303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz" event={"ID":"bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67","Type":"ContainerDied","Data":"7fd83934b3405a0aa8c6925ecb271d7e9c4fee4867c00b430d173b0b84965d51"}
Sep 15 21:40:17.684604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.684321    2560 scope.go:117] "RemoveContainer" containerID="2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"
Sep 15 21:40:17.694082 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.694060    2560 scope.go:117] "RemoveContainer" containerID="2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"
Sep 15 21:40:17.694360 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:40:17.694342    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe\": container with ID starting with 2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe not found: ID does not exist" containerID="2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"
Sep 15 21:40:17.694409 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.694371    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe"} err="failed to get container status \"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe\": rpc error: code = NotFound desc = could not find container \"2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe\": container with ID starting with 2c26f854ad141b6eaa0fdbb3a3c99f902e15fa4a360351d1d00378351afd0afe not found: ID does not exist"
Sep 15 21:40:17.706826 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.706797    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:40:17.711169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.711148    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/sub-test-model-3c4dc8-kserve-849cd75485-wb8qz"]
Sep 15 21:40:17.834239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834202    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:40:17.834584 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834572    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" containerName="main"
Sep 15 21:40:17.834662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834586    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" containerName="main"
Sep 15 21:40:17.834662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834608    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" containerName="main"
Sep 15 21:40:17.834662 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834615    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" containerName="main"
Sep 15 21:40:17.834756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834674    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" containerName="main"
Sep 15 21:40:17.834756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.834684    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e83bdbb-a175-4fbe-8b2b-6e7871db4bd5" containerName="main"
Sep 15 21:40:17.839241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.839223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.841962 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.841921    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"openshift-service-ca.crt\""
Sep 15 21:40:17.842127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.841960    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"kube-root-ca.crt\""
Sep 15 21:40:17.842127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.842054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"default-dockercfg-8r4z7\""
Sep 15 21:40:17.842509 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.842286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3c4dc8\"/\"rate-test-model-3c4dc8-kserve-self-signed-certs\""
Sep 15 21:40:17.848761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.848737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:40:17.864602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.864571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:17.940828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.940744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.940828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.940789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.941097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.940906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.941097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.940969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n76z\" (UniqueName: \"kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.941097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.941018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:17.941097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:17.941043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n76z\" (UniqueName: \"kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.042918 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.042833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.044514 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.044491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.044978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.044956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.050469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.050445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n76z\" (UniqueName: \"kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z\") pod \"rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") " pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.082671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.082638    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67" path="/var/lib/kubelet/pods/bdf97fc1-3deb-45ac-a0c5-26dc9ef2ab67/volumes"
Sep 15 21:40:18.150002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.149952    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:18.428963 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.428911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:40:18.430047 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:40:18.430010    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb55cac2c_dcb6_4db9_b585_4281d6a7ecfd.slice/crio-4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6 WatchSource:0}: Error finding container 4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6: Status 404 returned error can't find the container with id 4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6
Sep 15 21:40:18.692582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.692541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" event={"ID":"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd","Type":"ContainerStarted","Data":"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"}
Sep 15 21:40:18.692582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.692583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" event={"ID":"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd","Type":"ContainerStarted","Data":"4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6"}
Sep 15 21:40:18.712158 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:18.712059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" podStartSLOduration=1.712043017 podStartE2EDuration="1.712043017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:40:18.710204837 +0000 UTC m=+1913.114526885" watchObservedRunningTime="2026-09-15 21:40:18.712043017 +0000 UTC m=+1913.116365060"
Sep 15 21:40:20.795041 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:20.795006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:40:26.573889 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:26.573854    2560 scope.go:117] "RemoveContainer" containerID="75114875901b39238634a7117e29cbf4216b4c5de3a1618cb5e7b96ebb3244fb"
Sep 15 21:40:28.150147 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:28.150109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:28.150577 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:28.150162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:28.162983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:28.162951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:40:28.763393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:40:28.763364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:41:00.632718 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.632669    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:00.636035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.636012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.638731 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.638704    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"default-dockercfg-rvhzm\""
Sep 15 21:41:00.638911 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.638892    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"openshift-service-ca.crt\""
Sep 15 21:41:00.640202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.640181    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"kube-root-ca.crt\""
Sep 15 21:41:00.640319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.640214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7c57b6\"/\"rate-test-model-7c57b6-kserve-self-signed-certs\""
Sep 15 21:41:00.645496 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.645471    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:00.658113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.658086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:00.741341 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.741528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.741528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.741528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.741528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.741694 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.741547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w6cd\" (UniqueName: \"kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842469 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842651 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842870 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w6cd\" (UniqueName: \"kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.842931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.843019 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.842972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.843105 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.843083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.844877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.844860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.845160 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.845143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.851637 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.851613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w6cd\" (UniqueName: \"kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd\") pod \"rate-test-model-7c57b6-kserve-7b5848656c-q6fld\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") " pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:00.946497 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:00.946407    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:01.219868 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:01.219836    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:01.221298 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:41:01.221274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5450f4b_ad5d_427a_aaa6_650c8db873db.slice/crio-a9b3aeade22f19e37b714bbe94cc56e3db7023c30a412bb78ac797c7f82eea2f WatchSource:0}: Error finding container a9b3aeade22f19e37b714bbe94cc56e3db7023c30a412bb78ac797c7f82eea2f: Status 404 returned error can't find the container with id a9b3aeade22f19e37b714bbe94cc56e3db7023c30a412bb78ac797c7f82eea2f
Sep 15 21:41:01.940078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:01.940039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" event={"ID":"c5450f4b-ad5d-427a-aaa6-650c8db873db","Type":"ContainerStarted","Data":"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"}
Sep 15 21:41:01.940078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:01.940080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" event={"ID":"c5450f4b-ad5d-427a-aaa6-650c8db873db","Type":"ContainerStarted","Data":"a9b3aeade22f19e37b714bbe94cc56e3db7023c30a412bb78ac797c7f82eea2f"}
Sep 15 21:41:01.960160 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:01.960104    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" podStartSLOduration=1.960086963 podStartE2EDuration="1.960086963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:41:01.957621134 +0000 UTC m=+1956.361943181" watchObservedRunningTime="2026-09-15 21:41:01.960086963 +0000 UTC m=+1956.364409012"
Sep 15 21:41:02.953538 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:02.953498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:41:10.947106 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:10.947065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:10.947544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:10.947126    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:10.959448 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:10.959417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:11.003854 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:11.003825    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:18.577572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:18.577486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:20.690718 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:20.690676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:41:29.946674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:29.946634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:41:36.867473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:36.867434    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:41:36.887181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:36.887148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:37.816858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:37.816824    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:37.839729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:37.839699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:38.299807 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:38.299772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:38.404381 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:38.404348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:38.830483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:38.830439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:39.232492 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:39.232455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:40.565623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:40.565582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:41:40.807832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:40.807793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:41.562716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:41.562652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:41.679394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:41.679358    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:41.764508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:41.764475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:42.510062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:42.510024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:43.412088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:43.412053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:43.509070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:43.509038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:43.651215 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:43.651176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:44.017982 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.017953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:44.118118 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.118086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:44.132626 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.132591    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:41:44.137219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.137201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.139902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.139875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-7c0f45-dockercfg-wdhqm\""
Sep 15 21:41:44.140030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.139875    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7c0f45\""
Sep 15 21:41:44.147562 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.147539    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:41:44.156551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.156519    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:41:44.160218 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.160193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.172144 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.172117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:41:44.245322 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.245287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wsk\" (UniqueName: \"kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.245486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.245376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.245486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.245417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8sg\" (UniqueName: \"kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.245486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.245477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.346791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.346690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.346791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.346740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wsk\" (UniqueName: \"kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.347101 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.346829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.347101 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.346878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8sg\" (UniqueName: \"kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.347503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.347483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.347572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.347553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.355531 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.355505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8sg\" (UniqueName: \"kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg\") pod \"payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.355705 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.355682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wsk\" (UniqueName: \"kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk\") pod \"payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.448417 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.448382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:44.470913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.470880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:44.724275 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.724246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:41:44.725871 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:41:44.725843    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b7901d_de7a_4eef_875a_5ccc315f8f29.slice/crio-c2e492b28b9ae7361eb6df0f307e4ee2c1f18a953da099ee19b0fc0bd7f8338e WatchSource:0}: Error finding container c2e492b28b9ae7361eb6df0f307e4ee2c1f18a953da099ee19b0fc0bd7f8338e: Status 404 returned error can't find the container with id c2e492b28b9ae7361eb6df0f307e4ee2c1f18a953da099ee19b0fc0bd7f8338e
Sep 15 21:41:44.758472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:44.758444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:41:44.760088 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:41:44.760062    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acc05ce_c0ca_4746_99cd_2bc48705695f.slice/crio-a8d46ff879332e0fe3e0d6245c394d8e904bc4238e218b68618d53cd5d66d6e3 WatchSource:0}: Error finding container a8d46ff879332e0fe3e0d6245c394d8e904bc4238e218b68618d53cd5d66d6e3: Status 404 returned error can't find the container with id a8d46ff879332e0fe3e0d6245c394d8e904bc4238e218b68618d53cd5d66d6e3
Sep 15 21:41:45.189471 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.189420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" event={"ID":"f9b7901d-de7a-4eef-875a-5ccc315f8f29","Type":"ContainerStarted","Data":"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"}
Sep 15 21:41:45.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.189488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" event={"ID":"f9b7901d-de7a-4eef-875a-5ccc315f8f29","Type":"ContainerStarted","Data":"c2e492b28b9ae7361eb6df0f307e4ee2c1f18a953da099ee19b0fc0bd7f8338e"}
Sep 15 21:41:45.189665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.189519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:45.191254 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.191222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" event={"ID":"1acc05ce-c0ca-4746-99cd-2bc48705695f","Type":"ContainerStarted","Data":"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"}
Sep 15 21:41:45.191389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.191273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" event={"ID":"1acc05ce-c0ca-4746-99cd-2bc48705695f","Type":"ContainerStarted","Data":"a8d46ff879332e0fe3e0d6245c394d8e904bc4238e218b68618d53cd5d66d6e3"}
Sep 15 21:41:45.191389 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.191300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:41:45.207788 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.207740    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" podStartSLOduration=1.207723906 podStartE2EDuration="1.207723906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:41:45.20662839 +0000 UTC m=+1999.610950437" watchObservedRunningTime="2026-09-15 21:41:45.207723906 +0000 UTC m=+1999.612045953"
Sep 15 21:41:45.240030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:45.235246    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" podStartSLOduration=1.235218052 podStartE2EDuration="1.235218052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:41:45.228003518 +0000 UTC m=+1999.632325566" watchObservedRunningTime="2026-09-15 21:41:45.235218052 +0000 UTC m=+1999.639540099"
Sep 15 21:41:48.952174 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:48.952137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:41:51.886801 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:51.886753    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" podUID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" containerName="main" containerID="cri-o://a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8" gracePeriod=45
Sep 15 21:41:52.138554 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.138485    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:41:52.228089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228188    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n76z\" (UniqueName: \"kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228250    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm\") pod \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\" (UID: \"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd\") "
Sep 15 21:41:52.228721 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home" (OuterVolumeSpecName: "home") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:52.228860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:52.228860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.228740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache" (OuterVolumeSpecName: "model-cache") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:52.230604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.230572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:41:52.230726 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.230699    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm" (OuterVolumeSpecName: "dshm") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:52.230848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.230832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z" (OuterVolumeSpecName: "kube-api-access-2n76z") pod "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" (UID: "b55cac2c-dcb6-4db9-b585-4281d6a7ecfd"). InnerVolumeSpecName "kube-api-access-2n76z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:41:52.234797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.234770    2560 generic.go:356] "Generic (PLEG): container finished" podID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" containerID="a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8" exitCode=0
Sep 15 21:41:52.234900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.234869    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"
Sep 15 21:41:52.234977 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.234919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" event={"ID":"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd","Type":"ContainerDied","Data":"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"}
Sep 15 21:41:52.235033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.234985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq" event={"ID":"b55cac2c-dcb6-4db9-b585-4281d6a7ecfd","Type":"ContainerDied","Data":"4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6"}
Sep 15 21:41:52.235033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.235011    2560 scope.go:117] "RemoveContainer" containerID="a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"
Sep 15 21:41:52.258922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.258893    2560 scope.go:117] "RemoveContainer" containerID="a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"
Sep 15 21:41:52.259406 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:41:52.259385    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8\": container with ID starting with a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8 not found: ID does not exist" containerID="a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"
Sep 15 21:41:52.259474 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.259420    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8"} err="failed to get container status \"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8\": rpc error: code = NotFound desc = could not find container \"a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8\": container with ID starting with a41c554bb5f3221aa629de818bc9d10eaebd318a354a98387bf7563b6a1042a8 not found: ID does not exist"
Sep 15 21:41:52.266754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.266726    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:41:52.271945 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.271908    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3c4dc8/rate-test-model-3c4dc8-kserve-89859f6f9-sgvnq"]
Sep 15 21:41:52.286622 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:41:52.286592    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb55cac2c_dcb6_4db9_b585_4281d6a7ecfd.slice/crio-4ab639c1cbe30e235ee897c0a9af6332a4d82244e6038d1281dc54f0b96ffad6\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb55cac2c_dcb6_4db9_b585_4281d6a7ecfd.slice\": RecentStats: unable to find data in memory cache]"
Sep 15 21:41:52.329991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.329931    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.329991 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.329986    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.330189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.330018    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.330189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.330028    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.330189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.330037    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n76z\" (UniqueName: \"kubernetes.io/projected/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-kube-api-access-2n76z\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.330189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.330046    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:52.836145 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:52.836100    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" podUID="c5450f4b-ad5d-427a-aaa6-650c8db873db" containerName="main" containerID="cri-o://2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea" gracePeriod=45
Sep 15 21:41:53.084486 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.084461    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:53.239012 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.238977    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w6cd\" (UniqueName: \"kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239199 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm\") pod \"c5450f4b-ad5d-427a-aaa6-650c8db873db\" (UID: \"c5450f4b-ad5d-427a-aaa6-650c8db873db\") "
Sep 15 21:41:53.239421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:53.239421 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239324    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:53.239574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239468    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home" (OuterVolumeSpecName: "home") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:53.239574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239565    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:53.239695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239585    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:53.239695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.239599    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:53.241522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.241485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm" (OuterVolumeSpecName: "dshm") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:41:53.241633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.241523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:41:53.241633 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.241562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd" (OuterVolumeSpecName: "kube-api-access-9w6cd") pod "c5450f4b-ad5d-427a-aaa6-650c8db873db" (UID: "c5450f4b-ad5d-427a-aaa6-650c8db873db"). InnerVolumeSpecName "kube-api-access-9w6cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:41:53.242288 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.242263    2560 generic.go:356] "Generic (PLEG): container finished" podID="c5450f4b-ad5d-427a-aaa6-650c8db873db" containerID="2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea" exitCode=0
Sep 15 21:41:53.242382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.242300    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"
Sep 15 21:41:53.242382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.242335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" event={"ID":"c5450f4b-ad5d-427a-aaa6-650c8db873db","Type":"ContainerDied","Data":"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"}
Sep 15 21:41:53.242477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.242385    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld" event={"ID":"c5450f4b-ad5d-427a-aaa6-650c8db873db","Type":"ContainerDied","Data":"a9b3aeade22f19e37b714bbe94cc56e3db7023c30a412bb78ac797c7f82eea2f"}
Sep 15 21:41:53.242477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.242402    2560 scope.go:117] "RemoveContainer" containerID="2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"
Sep 15 21:41:53.261404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.261379    2560 scope.go:117] "RemoveContainer" containerID="2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"
Sep 15 21:41:53.261746 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:41:53.261721    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea\": container with ID starting with 2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea not found: ID does not exist" containerID="2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"
Sep 15 21:41:53.261816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.261755    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea"} err="failed to get container status \"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea\": rpc error: code = NotFound desc = could not find container \"2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea\": container with ID starting with 2ccfa61d8d4108ea49046de142208a0a13c66ddf4816f15dd34766ab2618daea not found: ID does not exist"
Sep 15 21:41:53.272365 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.272342    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:53.275966 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.275930    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7c57b6/rate-test-model-7c57b6-kserve-7b5848656c-q6fld"]
Sep 15 21:41:53.340241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.340195    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5450f4b-ad5d-427a-aaa6-650c8db873db-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:53.340241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.340238    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5450f4b-ad5d-427a-aaa6-650c8db873db-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:53.340241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:53.340247    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w6cd\" (UniqueName: \"kubernetes.io/projected/c5450f4b-ad5d-427a-aaa6-650c8db873db-kube-api-access-9w6cd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:41:54.082532 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:54.082495    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" path="/var/lib/kubelet/pods/b55cac2c-dcb6-4db9-b585-4281d6a7ecfd/volumes"
Sep 15 21:41:54.082893 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:54.082879    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5450f4b-ad5d-427a-aaa6-650c8db873db" path="/var/lib/kubelet/pods/c5450f4b-ad5d-427a-aaa6-650c8db873db/volumes"
Sep 15 21:41:56.199973 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:56.199921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:41:56.200363 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:41:56.200021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:42:05.644114 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:05.644071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:06.506796 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:06.506705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:06.606858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:06.606816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:07.227171 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:07.227133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:07.691787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:07.691726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:07.790602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:07.790562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.313301 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:08.313264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.427435 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:08.427399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:09.981476 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:09.981439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:10.656976 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:10.656915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:10.754741 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:10.754696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:11.617676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:11.617635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:12.537431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:12.537365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.362978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.362929    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:42:13.363528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363508    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5450f4b-ad5d-427a-aaa6-650c8db873db" containerName="main"
Sep 15 21:42:13.363623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363531    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5450f4b-ad5d-427a-aaa6-650c8db873db" containerName="main"
Sep 15 21:42:13.363623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" containerName="main"
Sep 15 21:42:13.363623 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" containerName="main"
Sep 15 21:42:13.363768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363686    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b55cac2c-dcb6-4db9-b585-4281d6a7ecfd" containerName="main"
Sep 15 21:42:13.363768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.363699    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5450f4b-ad5d-427a-aaa6-650c8db873db" containerName="main"
Sep 15 21:42:13.366984 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.366962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.372068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.372039    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:42:13.372068 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.372057    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vzmv2\""
Sep 15 21:42:13.372257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.372147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 21:42:13.372257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.372050    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 21:42:13.372257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.372045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-e985b6-serving-cert\""
Sep 15 21:42:13.379720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.379690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:42:13.404985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.404947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.427433 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.427399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.427613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.427440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.427613 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.427548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqcz\" (UniqueName: \"kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.427708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.427638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.505083 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.505046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.528380 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.528347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.528537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.528397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.528537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.528444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqcz\" (UniqueName: \"kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.528537 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.528490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.528704 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:42:13.528586    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-serving-cert: secret "maas-api-e2e-ipp-b-e985b6-serving-cert" not found
Sep 15 21:42:13.528704 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:42:13.528664    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls podName:c78f5eb7-1953-4459-9e96-2b2fb839ef08 nodeName:}" failed. No retries permitted until 2026-09-15 21:42:14.028647724 +0000 UTC m=+2028.432969753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls") pod "maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" (UID: "c78f5eb7-1953-4459-9e96-2b2fb839ef08") : secret "maas-api-e2e-ipp-b-e985b6-serving-cert" not found
Sep 15 21:42:13.529178 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.529153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.531184 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.531161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.537420 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.537395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqcz\" (UniqueName: \"kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:13.608822 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.608783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.879318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.879267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.987676 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.987615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:13.989212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.989190    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:42:13.992900 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.992883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:13.995344 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.995324    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-e985b6\""
Sep 15 21:42:13.995403 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:13.995347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-e985b6-dockercfg-n95lg\""
Sep 15 21:42:14.003482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.003455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:42:14.010133 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.010111    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:42:14.013549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.013532    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.026404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.026380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:42:14.032932 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.032908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:14.033044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.032964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfl7\" (UniqueName: \"kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.033044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.032997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.033044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.033020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.033197 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.033049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdwwc\" (UniqueName: \"kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.035411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.035388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:14.134258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.134160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfl7\" (UniqueName: \"kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.134258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.134209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.134258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.134249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.134551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.134286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdwwc\" (UniqueName: \"kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.138832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.135383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.138832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.135528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.144440 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.144414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfl7\" (UniqueName: \"kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7\") pod \"payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.144572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.144456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdwwc\" (UniqueName: \"kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc\") pod \"payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.280547 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.280511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:14.304820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.304794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:14.324067 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.324039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:14.555804 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.555777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:42:14.557550 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:42:14.557521    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78f5eb7_1953_4459_9e96_2b2fb839ef08.slice/crio-c83b300671a87b50aafbbd1b0ae3fe1f8f42577b6cbb1c9df0d5c8eb529484c4 WatchSource:0}: Error finding container c83b300671a87b50aafbbd1b0ae3fe1f8f42577b6cbb1c9df0d5c8eb529484c4: Status 404 returned error can't find the container with id c83b300671a87b50aafbbd1b0ae3fe1f8f42577b6cbb1c9df0d5c8eb529484c4
Sep 15 21:42:14.558818 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.558800    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:42:14.588472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.588448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:42:14.590585 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:42:14.590557    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28548b9_9a19_4326_ab45_9b5610c28ac9.slice/crio-1dcb4820087036f399af1aeb79e34b934591054a434f2df75956348fb3af6c80 WatchSource:0}: Error finding container 1dcb4820087036f399af1aeb79e34b934591054a434f2df75956348fb3af6c80: Status 404 returned error can't find the container with id 1dcb4820087036f399af1aeb79e34b934591054a434f2df75956348fb3af6c80
Sep 15 21:42:14.621559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:14.621534    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:42:14.625073 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:42:14.625038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee7cd08_78cf_4d48_af68_15445516e575.slice/crio-35cfcd0fd33c0bfeaf6ce739d7df44acd32a483918d8bf3f022c87444030ba6c WatchSource:0}: Error finding container 35cfcd0fd33c0bfeaf6ce739d7df44acd32a483918d8bf3f022c87444030ba6c: Status 404 returned error can't find the container with id 35cfcd0fd33c0bfeaf6ce739d7df44acd32a483918d8bf3f022c87444030ba6c
Sep 15 21:42:15.394006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.393965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" event={"ID":"fee7cd08-78cf-4d48-af68-15445516e575","Type":"ContainerStarted","Data":"ff6ab290b87ce2f1114d36551c1cd2b7c02b5ff2af94021be73dfbdc7fd21b0a"}
Sep 15 21:42:15.394232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.394152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:15.394232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.394200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" event={"ID":"fee7cd08-78cf-4d48-af68-15445516e575","Type":"ContainerStarted","Data":"35cfcd0fd33c0bfeaf6ce739d7df44acd32a483918d8bf3f022c87444030ba6c"}
Sep 15 21:42:15.395652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.395627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" event={"ID":"c78f5eb7-1953-4459-9e96-2b2fb839ef08","Type":"ContainerStarted","Data":"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"}
Sep 15 21:42:15.395772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.395671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" event={"ID":"c78f5eb7-1953-4459-9e96-2b2fb839ef08","Type":"ContainerStarted","Data":"c83b300671a87b50aafbbd1b0ae3fe1f8f42577b6cbb1c9df0d5c8eb529484c4"}
Sep 15 21:42:15.395772 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.395699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:15.397250 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.397227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" event={"ID":"f28548b9-9a19-4326-ab45-9b5610c28ac9","Type":"ContainerStarted","Data":"834f6eaa67ac7376ba2a7bbc90bc086a56a68ffd7e5c0bb323c4be16b03ec440"}
Sep 15 21:42:15.397348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.397267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" event={"ID":"f28548b9-9a19-4326-ab45-9b5610c28ac9","Type":"ContainerStarted","Data":"1dcb4820087036f399af1aeb79e34b934591054a434f2df75956348fb3af6c80"}
Sep 15 21:42:15.397348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.397300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:15.414444 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.414389    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" podStartSLOduration=2.414369318 podStartE2EDuration="2.414369318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:15.411160499 +0000 UTC m=+2029.815482545" watchObservedRunningTime="2026-09-15 21:42:15.414369318 +0000 UTC m=+2029.818691370"
Sep 15 21:42:15.429357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.429308    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" podStartSLOduration=2.429294172 podStartE2EDuration="2.429294172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:15.426563193 +0000 UTC m=+2029.830885239" watchObservedRunningTime="2026-09-15 21:42:15.429294172 +0000 UTC m=+2029.833616219"
Sep 15 21:42:15.444912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:15.444862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" podStartSLOduration=2.041013037 podStartE2EDuration="2.444846281s" totalImagesPullingTime="403.833244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:15.443071706 +0000 UTC m=+2029.847393755" watchObservedRunningTime="2026-09-15 21:42:15.444846281 +0000 UTC m=+2029.849168328"
Sep 15 21:42:17.959573 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:17.959534    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:42:20.461614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:20.461549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:21.408466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:21.408433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:42:26.405652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:26.405617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:42:26.406078 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:26.405701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:42:27.594712 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:27.594672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:34.269318 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:34.269284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:35.622865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:35.622829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:35.753927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:35.753890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:36.549102 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:36.549061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:37.244756 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:37.244701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:38.093410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:38.093367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:38.516139 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:38.516106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:38.800268 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:38.800178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:40.740544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:40.740514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j_fee7cd08-78cf-4d48-af68-15445516e575/payload-processing/0.log"
Sep 15 21:42:44.858253 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:44.858220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:48.669026 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:48.668923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:42:55.395216 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:42:55.395170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:15.358515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:15.358475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:43:21.617669 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:21.617633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf_1acc05ce-c0ca-4746-99cd-2bc48705695f/payload-processing/0.log"
Sep 15 21:43:21.849164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:21.849130    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j_fee7cd08-78cf-4d48-af68-15445516e575/payload-processing/0.log"
Sep 15 21:43:22.127193 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:22.127157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:22.452005 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:22.451900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:22.695141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:22.695107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:24.485348 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:24.485314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:25.065480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:25.065451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:25.166219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:25.166187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:25.307609 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:25.307575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:26.287292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:26.287258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:43:26.287728 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:26.287496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:26.291628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:26.291605    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:43:26.634293 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:26.634260    2560 scope.go:117] "RemoveContainer" containerID="c9792a1603e9ebfd42713beee14543eb18b49a58bf018ac5208095958c8b7542"
Sep 15 21:43:26.983688 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:26.983592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:27.736636 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:27.736599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:28.613481 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:28.613439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:28.717515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:28.717481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:28.813754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:28.813710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:29.119640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.119607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:29.222922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.222874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:29.321565 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.321529    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:43:29.326600 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.326582    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.329856 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.329831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-494d21\""
Sep 15 21:43:29.330006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.329897    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-494d21-dockercfg-rqlzn\""
Sep 15 21:43:29.336706 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.336677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:43:29.425303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.425204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6mv7\" (UniqueName: \"kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.425683 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.425650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.526725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.526683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6mv7\" (UniqueName: \"kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.526725 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.526731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.527428 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.527406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.535617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.535584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6mv7\" (UniqueName: \"kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7\") pod \"payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.638237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.638196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:29.910789 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:29.910760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:43:29.912219 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:43:29.912194    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34e838f_6afb_4d3d_ad89_45a57fbe96b5.slice/crio-76f0ea3dae8ef62995a01b5a68fc84bb595e1d8c78303bdef93d38da9daeca5f WatchSource:0}: Error finding container 76f0ea3dae8ef62995a01b5a68fc84bb595e1d8c78303bdef93d38da9daeca5f: Status 404 returned error can't find the container with id 76f0ea3dae8ef62995a01b5a68fc84bb595e1d8c78303bdef93d38da9daeca5f
Sep 15 21:43:30.829794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:30.829752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" event={"ID":"e34e838f-6afb-4d3d-ad89-45a57fbe96b5","Type":"ContainerStarted","Data":"a7b2e57bff8cf1955113ec9b9e2ef615dc706fc89d523c77c939f316d9dd7626"}
Sep 15 21:43:30.830010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:30.829819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" event={"ID":"e34e838f-6afb-4d3d-ad89-45a57fbe96b5","Type":"ContainerStarted","Data":"76f0ea3dae8ef62995a01b5a68fc84bb595e1d8c78303bdef93d38da9daeca5f"}
Sep 15 21:43:30.830010 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:30.829847    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:30.847750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:30.847691    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" podStartSLOduration=1.847671499 podStartE2EDuration="1.847671499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:43:30.846878959 +0000 UTC m=+2105.251201006" watchObservedRunningTime="2026-09-15 21:43:30.847671499 +0000 UTC m=+2105.251993546"
Sep 15 21:43:34.380647 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:34.380604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:43:41.838404 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:41.838369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:43:50.787957 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:50.787901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:52.093571 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:52.093525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:52.385134 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:52.385072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:53.496070 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:53.496033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:54.191366 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:54.191331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:54.901241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:54.901209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:55.218502 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.218416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:55.924712 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.924668    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"]
Sep 15 21:43:55.928492 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.928473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:55.931286 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.931260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:43:55.937237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.937212    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"]
Sep 15 21:43:55.974566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:55.974529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24\" (UID: \"71b95851-13c1-4211-9a71-dae1eea2237e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:56.075511 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.075471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24\" (UID: \"71b95851-13c1-4211-9a71-dae1eea2237e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:56.076151 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.076133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24\" (UID: \"71b95851-13c1-4211-9a71-dae1eea2237e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:56.241619 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.241525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:56.512422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.512395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"]
Sep 15 21:43:56.513560 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:43:56.513522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b95851_13c1_4211_9a71_dae1eea2237e.slice/crio-957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74 WatchSource:0}: Error finding container 957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74: Status 404 returned error can't find the container with id 957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74
Sep 15 21:43:56.696031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.695999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:56.989442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.989406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24" event={"ID":"71b95851-13c1-4211-9a71-dae1eea2237e","Type":"ContainerStarted","Data":"36217341e51ce351a6d561f12119564052630222bbdbba72b5c7049c68f88ed1"}
Sep 15 21:43:56.989794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:56.989462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24" event={"ID":"71b95851-13c1-4211-9a71-dae1eea2237e","Type":"ContainerStarted","Data":"957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74"}
Sep 15 21:43:57.007370 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:57.007318    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24" podStartSLOduration=2.007301506 podStartE2EDuration="2.007301506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:43:57.00392947 +0000 UTC m=+2131.408251516" watchObservedRunningTime="2026-09-15 21:43:57.007301506 +0000 UTC m=+2131.411623552"
Sep 15 21:43:57.563847 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:57.563757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:57.997265 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:57.997225    2560 generic.go:356] "Generic (PLEG): container finished" podID="71b95851-13c1-4211-9a71-dae1eea2237e" containerID="36217341e51ce351a6d561f12119564052630222bbdbba72b5c7049c68f88ed1" exitCode=0
Sep 15 21:43:57.997645 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:57.997309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24" event={"ID":"71b95851-13c1-4211-9a71-dae1eea2237e","Type":"ContainerDied","Data":"36217341e51ce351a6d561f12119564052630222bbdbba72b5c7049c68f88ed1"}
Sep 15 21:43:58.302765 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:58.302677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:59.135608 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:59.135580    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:43:59.164169 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:59.164135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:59.207076 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:59.207049    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca\") pod \"71b95851-13c1-4211-9a71-dae1eea2237e\" (UID: \"71b95851-13c1-4211-9a71-dae1eea2237e\") "
Sep 15 21:43:59.207430 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:59.207405    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71b95851-13c1-4211-9a71-dae1eea2237e" (UID: "71b95851-13c1-4211-9a71-dae1eea2237e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:43:59.308304 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:43:59.308223    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b95851-13c1-4211-9a71-dae1eea2237e-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:00.010744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:00.010705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24" event={"ID":"71b95851-13c1-4211-9a71-dae1eea2237e","Type":"ContainerDied","Data":"957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74"}
Sep 15 21:44:00.010744 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:00.010728    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"
Sep 15 21:44:00.010978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:00.010780    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="957997f6055ffff269ae57181be6161b40f08dee0a14bb62c662c07a0eb62c74"
Sep 15 21:44:00.119775 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:00.119742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:00.885063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:00.885026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:06.846614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:06.846571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:06.884877 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:06.884835    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:44:06.885175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:06.885146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" podUID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" containerName="payload-pre-processing" containerID="cri-o://a7b2e57bff8cf1955113ec9b9e2ef615dc706fc89d523c77c939f316d9dd7626" gracePeriod=30
Sep 15 21:44:06.918477 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:06.918418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:07.019547 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.019514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:07.052309 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.052275    2560 generic.go:356] "Generic (PLEG): container finished" podID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" containerID="a7b2e57bff8cf1955113ec9b9e2ef615dc706fc89d523c77c939f316d9dd7626" exitCode=0
Sep 15 21:44:07.052482 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.052352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" event={"ID":"e34e838f-6afb-4d3d-ad89-45a57fbe96b5","Type":"ContainerDied","Data":"a7b2e57bff8cf1955113ec9b9e2ef615dc706fc89d523c77c939f316d9dd7626"}
Sep 15 21:44:07.063768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.063728    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"]
Sep 15 21:44:07.067764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.067739    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-494d21-w6g24"]
Sep 15 21:44:07.083817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.083771    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:07.148914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.148882    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:44:07.284202 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.284157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume\") pod \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") "
Sep 15 21:44:07.284402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.284272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6mv7\" (UniqueName: \"kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7\") pod \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\" (UID: \"e34e838f-6afb-4d3d-ad89-45a57fbe96b5\") "
Sep 15 21:44:07.284652 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.284624    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e34e838f-6afb-4d3d-ad89-45a57fbe96b5" (UID: "e34e838f-6afb-4d3d-ad89-45a57fbe96b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:07.286470 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.286449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7" (OuterVolumeSpecName: "kube-api-access-c6mv7") pod "e34e838f-6afb-4d3d-ad89-45a57fbe96b5" (UID: "e34e838f-6afb-4d3d-ad89-45a57fbe96b5"). InnerVolumeSpecName "kube-api-access-c6mv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:44:07.386121 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.386031    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:07.386121 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.386068    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6mv7\" (UniqueName: \"kubernetes.io/projected/e34e838f-6afb-4d3d-ad89-45a57fbe96b5-kube-api-access-c6mv7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:07.438219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.438177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:07.538053 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:07.538015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:08.059656 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.059626    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"
Sep 15 21:44:08.060088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.059668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm" event={"ID":"e34e838f-6afb-4d3d-ad89-45a57fbe96b5","Type":"ContainerDied","Data":"76f0ea3dae8ef62995a01b5a68fc84bb595e1d8c78303bdef93d38da9daeca5f"}
Sep 15 21:44:08.060088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.059728    2560 scope.go:117] "RemoveContainer" containerID="a7b2e57bff8cf1955113ec9b9e2ef615dc706fc89d523c77c939f316d9dd7626"
Sep 15 21:44:08.083135 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.083108    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b95851-13c1-4211-9a71-dae1eea2237e" path="/var/lib/kubelet/pods/71b95851-13c1-4211-9a71-dae1eea2237e/volumes"
Sep 15 21:44:08.085460 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.085439    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:44:08.088947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.088910    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-494d21-77c587bdb-zhdnm"]
Sep 15 21:44:08.293617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:08.293586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:09.187117 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:09.187085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:10.004399 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:10.004366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:10.081872 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:10.081840    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" path="/var/lib/kubelet/pods/e34e838f-6afb-4d3d-ad89-45a57fbe96b5/volumes"
Sep 15 21:44:10.894863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:10.894827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:11.754187 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:11.754151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:44:13.336163 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:13.336129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:13.438895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:13.438865    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:13.599291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:13.599264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:17.175310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.175275    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"]
Sep 15 21:44:17.175899 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.175881    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" containerName="payload-pre-processing"
Sep 15 21:44:17.175972 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.175901    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" containerName="payload-pre-processing"
Sep 15 21:44:17.175972 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.175923    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b95851-13c1-4211-9a71-dae1eea2237e" containerName="revoke-keys"
Sep 15 21:44:17.175972 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.175929    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b95851-13c1-4211-9a71-dae1eea2237e" containerName="revoke-keys"
Sep 15 21:44:17.176073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.176013    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34e838f-6afb-4d3d-ad89-45a57fbe96b5" containerName="payload-pre-processing"
Sep 15 21:44:17.176073 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.176027    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b95851-13c1-4211-9a71-dae1eea2237e" containerName="revoke-keys"
Sep 15 21:44:17.180278 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.180262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:17.184210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.184184    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:44:17.187291 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.187264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"]
Sep 15 21:44:17.284731 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.284686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8\" (UID: \"5e49d777-8307-4dd7-808d-11888caaec50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:17.318058 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.318026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:17.385264 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.385227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8\" (UID: \"5e49d777-8307-4dd7-808d-11888caaec50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:17.385899 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.385873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8\" (UID: \"5e49d777-8307-4dd7-808d-11888caaec50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:17.492834 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.492729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:17.780913 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:17.780887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"]
Sep 15 21:44:17.783432 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:44:17.783401    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e49d777_8307_4dd7_808d_11888caaec50.slice/crio-cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34 WatchSource:0}: Error finding container cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34: Status 404 returned error can't find the container with id cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34
Sep 15 21:44:18.119659 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:18.119629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8" event={"ID":"5e49d777-8307-4dd7-808d-11888caaec50","Type":"ContainerStarted","Data":"34c289a41ba9a68258a2031d2af0aaeb9c4bd1103415693832695093747447dc"}
Sep 15 21:44:18.119799 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:18.119683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8" event={"ID":"5e49d777-8307-4dd7-808d-11888caaec50","Type":"ContainerStarted","Data":"cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34"}
Sep 15 21:44:18.149534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:18.149482    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8" podStartSLOduration=1.149467074 podStartE2EDuration="1.149467074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:44:18.146987448 +0000 UTC m=+2152.551309493" watchObservedRunningTime="2026-09-15 21:44:18.149467074 +0000 UTC m=+2152.553789142"
Sep 15 21:44:18.288729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:18.288693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:19.127148 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:19.127110    2560 generic.go:356] "Generic (PLEG): container finished" podID="5e49d777-8307-4dd7-808d-11888caaec50" containerID="34c289a41ba9a68258a2031d2af0aaeb9c4bd1103415693832695093747447dc" exitCode=0
Sep 15 21:44:19.127327 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:19.127186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8" event={"ID":"5e49d777-8307-4dd7-808d-11888caaec50","Type":"ContainerDied","Data":"34c289a41ba9a68258a2031d2af0aaeb9c4bd1103415693832695093747447dc"}
Sep 15 21:44:19.214491 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:19.214446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:20.087007 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.086975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:20.269033 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.269004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:20.415063 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.415027    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca\") pod \"5e49d777-8307-4dd7-808d-11888caaec50\" (UID: \"5e49d777-8307-4dd7-808d-11888caaec50\") "
Sep 15 21:44:20.415359 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.415337    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e49d777-8307-4dd7-808d-11888caaec50" (UID: "5e49d777-8307-4dd7-808d-11888caaec50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:20.516456 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.516420    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e49d777-8307-4dd7-808d-11888caaec50-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:20.785908 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:20.785822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:21.139989 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:21.139957    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"
Sep 15 21:44:21.140422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:21.139989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8" event={"ID":"5e49d777-8307-4dd7-808d-11888caaec50","Type":"ContainerDied","Data":"cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34"}
Sep 15 21:44:21.140422 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:21.140048    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cead70e64e5d62147124677c058d80103c3080f48a88c8bec11f4e928759bf34"
Sep 15 21:44:21.593777 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:21.593696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:26.659411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:26.659380    2560 scope.go:117] "RemoveContainer" containerID="075b5fb523a1e3471e7ce26925766c1c757daeea3e1603d689d3a06bd76b3b5f"
Sep 15 21:44:26.668144 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:26.668123    2560 scope.go:117] "RemoveContainer" containerID="df832ed03db0ee50bd425cca1b9e1f908a75e92f5a29e4a4d53d172a2a30c7aa"
Sep 15 21:44:26.676473 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:26.676451    2560 scope.go:117] "RemoveContainer" containerID="bcd5fad61c8a74dee29c3b5256ee173079dbd517a44ceb283fda5b9328ef36b1"
Sep 15 21:44:26.686755 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:26.686732    2560 scope.go:117] "RemoveContainer" containerID="4f059e54d36d39cd6c245bb7664dbf318d949cd403f4cab112d08f50162d0f6b"
Sep 15 21:44:30.258320 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:30.258283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:44:32.723649 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.723608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:32.757094 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.757060    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:44:32.757374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.757323    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" podUID="1acc05ce-c0ca-4746-99cd-2bc48705695f" containerName="payload-processing" containerID="cri-o://ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0" gracePeriod=30
Sep 15 21:44:32.765237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.765202    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:44:32.765612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.765578    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" podUID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" containerName="payload-pre-processing" containerID="cri-o://0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a" gracePeriod=30
Sep 15 21:44:32.798316 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.798266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:32.861545 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.861501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:32.946569 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.946505    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"]
Sep 15 21:44:32.947060 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.947024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:32.949692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:32.949666    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7c0f45-xsms8"]
Sep 15 21:44:33.013339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.013310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:33.016774 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.016730    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:44:33.029467 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.029441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume\") pod \"1acc05ce-c0ca-4746-99cd-2bc48705695f\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") "
Sep 15 21:44:33.029551 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.029493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2wsk\" (UniqueName: \"kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk\") pod \"1acc05ce-c0ca-4746-99cd-2bc48705695f\" (UID: \"1acc05ce-c0ca-4746-99cd-2bc48705695f\") "
Sep 15 21:44:33.029769 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.029747    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1acc05ce-c0ca-4746-99cd-2bc48705695f" (UID: "1acc05ce-c0ca-4746-99cd-2bc48705695f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:33.031507 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.031485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk" (OuterVolumeSpecName: "kube-api-access-h2wsk") pod "1acc05ce-c0ca-4746-99cd-2bc48705695f" (UID: "1acc05ce-c0ca-4746-99cd-2bc48705695f"). InnerVolumeSpecName "kube-api-access-h2wsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:44:33.045105 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.045078    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:44:33.130181 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.130141    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume\") pod \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") "
Sep 15 21:44:33.130362 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.130191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz8sg\" (UniqueName: \"kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg\") pod \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\" (UID: \"f9b7901d-de7a-4eef-875a-5ccc315f8f29\") "
Sep 15 21:44:33.130406 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.130385    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1acc05ce-c0ca-4746-99cd-2bc48705695f-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:33.130406 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.130396    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2wsk\" (UniqueName: \"kubernetes.io/projected/1acc05ce-c0ca-4746-99cd-2bc48705695f-kube-api-access-h2wsk\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:33.130544 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.130519    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9b7901d-de7a-4eef-875a-5ccc315f8f29" (UID: "f9b7901d-de7a-4eef-875a-5ccc315f8f29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:33.132219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.132199    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg" (OuterVolumeSpecName: "kube-api-access-xz8sg") pod "f9b7901d-de7a-4eef-875a-5ccc315f8f29" (UID: "f9b7901d-de7a-4eef-875a-5ccc315f8f29"). InnerVolumeSpecName "kube-api-access-xz8sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:44:33.209589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.209553    2560 generic.go:356] "Generic (PLEG): container finished" podID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" containerID="0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a" exitCode=0
Sep 15 21:44:33.209761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.209599    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"
Sep 15 21:44:33.209761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.209632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" event={"ID":"f9b7901d-de7a-4eef-875a-5ccc315f8f29","Type":"ContainerDied","Data":"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"}
Sep 15 21:44:33.209761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.209689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9" event={"ID":"f9b7901d-de7a-4eef-875a-5ccc315f8f29","Type":"ContainerDied","Data":"c2e492b28b9ae7361eb6df0f307e4ee2c1f18a953da099ee19b0fc0bd7f8338e"}
Sep 15 21:44:33.209761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.209722    2560 scope.go:117] "RemoveContainer" containerID="0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"
Sep 15 21:44:33.211071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.211050    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acc05ce-c0ca-4746-99cd-2bc48705695f" containerID="ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0" exitCode=0
Sep 15 21:44:33.211176 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.211091    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"
Sep 15 21:44:33.211176 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.211127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" event={"ID":"1acc05ce-c0ca-4746-99cd-2bc48705695f","Type":"ContainerDied","Data":"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"}
Sep 15 21:44:33.211284 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.211178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf" event={"ID":"1acc05ce-c0ca-4746-99cd-2bc48705695f","Type":"ContainerDied","Data":"a8d46ff879332e0fe3e0d6245c394d8e904bc4238e218b68618d53cd5d66d6e3"}
Sep 15 21:44:33.219308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.219291    2560 scope.go:117] "RemoveContainer" containerID="0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"
Sep 15 21:44:33.219612 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:44:33.219592    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a\": container with ID starting with 0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a not found: ID does not exist" containerID="0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"
Sep 15 21:44:33.219664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.219621    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a"} err="failed to get container status \"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a\": rpc error: code = NotFound desc = could not find container \"0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a\": container with ID starting with 0cb1f0b47f3f90dc165ded50ec2630925ea7fde58dacd785ff3fa8304a48828a not found: ID does not exist"
Sep 15 21:44:33.219664 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.219637    2560 scope.go:117] "RemoveContainer" containerID="ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"
Sep 15 21:44:33.228337 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.228319    2560 scope.go:117] "RemoveContainer" containerID="ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"
Sep 15 21:44:33.228600 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:44:33.228582    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0\": container with ID starting with ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0 not found: ID does not exist" containerID="ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"
Sep 15 21:44:33.228643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.228607    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0"} err="failed to get container status \"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0\": rpc error: code = NotFound desc = could not find container \"ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0\": container with ID starting with ffc18c82fb0b534615596c187a63ba1779659d6aa5be31e2d3f60a8c858504e0 not found: ID does not exist"
Sep 15 21:44:33.231069 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.231049    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b7901d-de7a-4eef-875a-5ccc315f8f29-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:33.231137 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.231070    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8sg\" (UniqueName: \"kubernetes.io/projected/f9b7901d-de7a-4eef-875a-5ccc315f8f29-kube-api-access-xz8sg\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:44:33.235046 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.235024    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:44:33.241092 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.241064    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0f45-589485644b-pwtq9"]
Sep 15 21:44:33.252517 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.252456    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:44:33.257449 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.257425    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7c0f45-8656fdff9-v4tqf"]
Sep 15 21:44:33.305472 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.305444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:33.407394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:33.407360    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:34.083843 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:34.083766    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1acc05ce-c0ca-4746-99cd-2bc48705695f" path="/var/lib/kubelet/pods/1acc05ce-c0ca-4746-99cd-2bc48705695f/volumes"
Sep 15 21:44:34.084191 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:34.084178    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e49d777-8307-4dd7-808d-11888caaec50" path="/var/lib/kubelet/pods/5e49d777-8307-4dd7-808d-11888caaec50/volumes"
Sep 15 21:44:34.084533 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:34.084520    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" path="/var/lib/kubelet/pods/f9b7901d-de7a-4eef-875a-5ccc315f8f29/volumes"
Sep 15 21:44:34.222753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:34.222721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:35.139029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:35.138992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:35.961186 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:35.961150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:38.364462 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:38.364419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:43.946155 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:44:43.946113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:45:00.157424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157384    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"]
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157824    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acc05ce-c0ca-4746-99cd-2bc48705695f" containerName="payload-processing"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157842    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acc05ce-c0ca-4746-99cd-2bc48705695f" containerName="payload-processing"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157865    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" containerName="payload-pre-processing"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157871    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" containerName="payload-pre-processing"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157881    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e49d777-8307-4dd7-808d-11888caaec50" containerName="revoke-keys"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157886    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e49d777-8307-4dd7-808d-11888caaec50" containerName="revoke-keys"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157985    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b7901d-de7a-4eef-875a-5ccc315f8f29" containerName="payload-pre-processing"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.157999    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e49d777-8307-4dd7-808d-11888caaec50" containerName="revoke-keys"
Sep 15 21:45:00.158022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.158005    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acc05ce-c0ca-4746-99cd-2bc48705695f" containerName="payload-processing"
Sep 15 21:45:00.162704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.162680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"
Sep 15 21:45:00.166041 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.166024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:45:00.173816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.173788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"]
Sep 15 21:45:00.174502 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.174483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"
Sep 15 21:45:00.452918 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:00.452888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"]
Sep 15 21:45:00.453269 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:45:00.453245    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acd41cb_78cf_4e7b_ac8b_40471889cb4c.slice/crio-b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484 WatchSource:0}: Error finding container b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484: Status 404 returned error can't find the container with id b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484
Sep 15 21:45:01.370857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:01.370819    2560 generic.go:356] "Generic (PLEG): container finished" podID="8acd41cb-78cf-4e7b-ac8b-40471889cb4c" containerID="afea1940c68dfeb65acddfeaea38b8b07eb2da008546191decf132a20ca324b8" exitCode=0
Sep 15 21:45:01.370857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:01.370859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh" event={"ID":"8acd41cb-78cf-4e7b-ac8b-40471889cb4c","Type":"ContainerDied","Data":"afea1940c68dfeb65acddfeaea38b8b07eb2da008546191decf132a20ca324b8"}
Sep 15 21:45:01.371310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:01.370898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh" event={"ID":"8acd41cb-78cf-4e7b-ac8b-40471889cb4c","Type":"ContainerStarted","Data":"b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484"}
Sep 15 21:45:02.504480 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:02.504453    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"
Sep 15 21:45:03.383710 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:03.383678    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"
Sep 15 21:45:03.383919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:03.383728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh" event={"ID":"8acd41cb-78cf-4e7b-ac8b-40471889cb4c","Type":"ContainerDied","Data":"b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484"}
Sep 15 21:45:03.383919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:03.383776    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0ce7b978dd54e7a7cdae2d8331897b5dca140c4901dc2f91acd328e80003484"
Sep 15 21:45:14.456257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:14.456224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:15.945165 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:15.945126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:21.952001 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:21.951958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:22.052447 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:22.052413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:22.219179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:22.219097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:22.849847 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:22.849809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:23.680999 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:23.680963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:24.473153 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:24.473119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:25.301499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:25.301459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:26.026522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:26.026485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:33.222323 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.222285    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:45:33.222860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.222540    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" podUID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" containerName="maas-api" containerID="cri-o://a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb" gracePeriod=30
Sep 15 21:45:33.255726 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.255677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:33.292787 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.292729    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:45:33.293044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.293014    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" podUID="fee7cd08-78cf-4d48-af68-15445516e575" containerName="payload-processing" containerID="cri-o://ff6ab290b87ce2f1114d36551c1cd2b7c02b5ff2af94021be73dfbdc7fd21b0a" gracePeriod=30
Sep 15 21:45:33.305027 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.304993    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:45:33.305303 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.305277    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" podUID="f28548b9-9a19-4326-ab45-9b5610c28ac9" containerName="payload-pre-processing" containerID="cri-o://834f6eaa67ac7376ba2a7bbc90bc086a56a68ffd7e5c0bb323c4be16b03ec440" gracePeriod=30
Sep 15 21:45:33.338948 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.338906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:33.442535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.442456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:33.507509 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.507400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:33.557617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.557582    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:45:33.559891 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.559863    2560 generic.go:356] "Generic (PLEG): container finished" podID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" containerID="a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb" exitCode=0
Sep 15 21:45:33.560037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.559899    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"
Sep 15 21:45:33.560037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.559970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" event={"ID":"c78f5eb7-1953-4459-9e96-2b2fb839ef08","Type":"ContainerDied","Data":"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"}
Sep 15 21:45:33.560037 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.560031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8" event={"ID":"c78f5eb7-1953-4459-9e96-2b2fb839ef08","Type":"ContainerDied","Data":"c83b300671a87b50aafbbd1b0ae3fe1f8f42577b6cbb1c9df0d5c8eb529484c4"}
Sep 15 21:45:33.560204 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.560064    2560 scope.go:117] "RemoveContainer" containerID="a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"
Sep 15 21:45:33.561853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.561831    2560 generic.go:356] "Generic (PLEG): container finished" podID="f28548b9-9a19-4326-ab45-9b5610c28ac9" containerID="834f6eaa67ac7376ba2a7bbc90bc086a56a68ffd7e5c0bb323c4be16b03ec440" exitCode=0
Sep 15 21:45:33.561999 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.561903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" event={"ID":"f28548b9-9a19-4326-ab45-9b5610c28ac9","Type":"ContainerDied","Data":"834f6eaa67ac7376ba2a7bbc90bc086a56a68ffd7e5c0bb323c4be16b03ec440"}
Sep 15 21:45:33.563708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.563689    2560 generic.go:356] "Generic (PLEG): container finished" podID="fee7cd08-78cf-4d48-af68-15445516e575" containerID="ff6ab290b87ce2f1114d36551c1cd2b7c02b5ff2af94021be73dfbdc7fd21b0a" exitCode=0
Sep 15 21:45:33.563791 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.563725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" event={"ID":"fee7cd08-78cf-4d48-af68-15445516e575","Type":"ContainerDied","Data":"ff6ab290b87ce2f1114d36551c1cd2b7c02b5ff2af94021be73dfbdc7fd21b0a"}
Sep 15 21:45:33.569627 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.569610    2560 scope.go:117] "RemoveContainer" containerID="a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"
Sep 15 21:45:33.569928 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:45:33.569908    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb\": container with ID starting with a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb not found: ID does not exist" containerID="a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"
Sep 15 21:45:33.570034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.569954    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb"} err="failed to get container status \"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb\": rpc error: code = NotFound desc = could not find container \"a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb\": container with ID starting with a07f61fede499deb0033d22aab070ff01bb7b37f38cc9072bcb09f962a112ccb not found: ID does not exist"
Sep 15 21:45:33.589442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.589407    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfqcz\" (UniqueName: \"kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz\") pod \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") "
Sep 15 21:45:33.589589 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.589572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") pod \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") "
Sep 15 21:45:33.589686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.589666    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs\") pod \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") "
Sep 15 21:45:33.589770 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.589703    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca\") pod \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\" (UID: \"c78f5eb7-1953-4459-9e96-2b2fb839ef08\") "
Sep 15 21:45:33.590489 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.590272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c78f5eb7-1953-4459-9e96-2b2fb839ef08" (UID: "c78f5eb7-1953-4459-9e96-2b2fb839ef08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:33.591693 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.591667    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz" (OuterVolumeSpecName: "kube-api-access-wfqcz") pod "c78f5eb7-1953-4459-9e96-2b2fb839ef08" (UID: "c78f5eb7-1953-4459-9e96-2b2fb839ef08"). InnerVolumeSpecName "kube-api-access-wfqcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:33.591957 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.591916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c78f5eb7-1953-4459-9e96-2b2fb839ef08" (UID: "c78f5eb7-1953-4459-9e96-2b2fb839ef08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:45:33.592106 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.592087    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c78f5eb7-1953-4459-9e96-2b2fb839ef08" (UID: "c78f5eb7-1953-4459-9e96-2b2fb839ef08"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:45:33.597978 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.597956    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:45:33.601002 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.600927    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:45:33.691038 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume\") pod \"f28548b9-9a19-4326-ab45-9b5610c28ac9\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") "
Sep 15 21:45:33.691214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdwwc\" (UniqueName: \"kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc\") pod \"fee7cd08-78cf-4d48-af68-15445516e575\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") "
Sep 15 21:45:33.691214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume\") pod \"fee7cd08-78cf-4d48-af68-15445516e575\" (UID: \"fee7cd08-78cf-4d48-af68-15445516e575\") "
Sep 15 21:45:33.691214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691155    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sfl7\" (UniqueName: \"kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7\") pod \"f28548b9-9a19-4326-ab45-9b5610c28ac9\" (UID: \"f28548b9-9a19-4326-ab45-9b5610c28ac9\") "
Sep 15 21:45:33.691432 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691406    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f28548b9-9a19-4326-ab45-9b5610c28ac9" (UID: "f28548b9-9a19-4326-ab45-9b5610c28ac9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:33.691499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691441    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfqcz\" (UniqueName: \"kubernetes.io/projected/c78f5eb7-1953-4459-9e96-2b2fb839ef08-kube-api-access-wfqcz\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.691499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691463    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-maas-api-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.691499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691478    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c78f5eb7-1953-4459-9e96-2b2fb839ef08-metrics-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.691499 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fee7cd08-78cf-4d48-af68-15445516e575" (UID: "fee7cd08-78cf-4d48-af68-15445516e575"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:33.691640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.691491    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78f5eb7-1953-4459-9e96-2b2fb839ef08-openshift-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.693227 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.693208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7" (OuterVolumeSpecName: "kube-api-access-8sfl7") pod "f28548b9-9a19-4326-ab45-9b5610c28ac9" (UID: "f28548b9-9a19-4326-ab45-9b5610c28ac9"). InnerVolumeSpecName "kube-api-access-8sfl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:33.693287 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.693251    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc" (OuterVolumeSpecName: "kube-api-access-gdwwc") pod "fee7cd08-78cf-4d48-af68-15445516e575" (UID: "fee7cd08-78cf-4d48-af68-15445516e575"). InnerVolumeSpecName "kube-api-access-gdwwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:33.792570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.792478    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f28548b9-9a19-4326-ab45-9b5610c28ac9-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.792570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.792511    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdwwc\" (UniqueName: \"kubernetes.io/projected/fee7cd08-78cf-4d48-af68-15445516e575-kube-api-access-gdwwc\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.792570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.792523    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fee7cd08-78cf-4d48-af68-15445516e575-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.792570 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.792535    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sfl7\" (UniqueName: \"kubernetes.io/projected/f28548b9-9a19-4326-ab45-9b5610c28ac9-kube-api-access-8sfl7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:33.883632 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.883596    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:45:33.887535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.887505    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e985b6-59cf457f99-q97s8"]
Sep 15 21:45:33.989574 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:33.989540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:34.082418 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.082333    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" path="/var/lib/kubelet/pods/c78f5eb7-1953-4459-9e96-2b2fb839ef08/volumes"
Sep 15 21:45:34.095212 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.095183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:34.571220 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.571183    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"
Sep 15 21:45:34.571220 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.571201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv" event={"ID":"f28548b9-9a19-4326-ab45-9b5610c28ac9","Type":"ContainerDied","Data":"1dcb4820087036f399af1aeb79e34b934591054a434f2df75956348fb3af6c80"}
Sep 15 21:45:34.571746 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.571268    2560 scope.go:117] "RemoveContainer" containerID="834f6eaa67ac7376ba2a7bbc90bc086a56a68ffd7e5c0bb323c4be16b03ec440"
Sep 15 21:45:34.572896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.572873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"
Sep 15 21:45:34.573030 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.572883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j" event={"ID":"fee7cd08-78cf-4d48-af68-15445516e575","Type":"ContainerDied","Data":"35cfcd0fd33c0bfeaf6ce739d7df44acd32a483918d8bf3f022c87444030ba6c"}
Sep 15 21:45:34.583620 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.583598    2560 scope.go:117] "RemoveContainer" containerID="ff6ab290b87ce2f1114d36551c1cd2b7c02b5ff2af94021be73dfbdc7fd21b0a"
Sep 15 21:45:34.595310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.595286    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:45:34.598866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.598843    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e985b6-7cbf947c4b-5wlsv"]
Sep 15 21:45:34.609050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.609027    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:45:34.611139 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.611118    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e985b6-59cb5d744f-cbs4j"]
Sep 15 21:45:34.713603 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:34.713567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:35.584066 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:35.584021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:36.081950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:36.081905    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f28548b9-9a19-4326-ab45-9b5610c28ac9" path="/var/lib/kubelet/pods/f28548b9-9a19-4326-ab45-9b5610c28ac9/volumes"
Sep 15 21:45:36.082357 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:36.082342    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee7cd08-78cf-4d48-af68-15445516e575" path="/var/lib/kubelet/pods/fee7cd08-78cf-4d48-af68-15445516e575/volumes"
Sep 15 21:45:36.949697 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:36.949660    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:45:40.011566 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.011519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.112166 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.112123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.292434 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.292356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.625442 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"]
Sep 15 21:45:40.625768 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee7cd08-78cf-4d48-af68-15445516e575" containerName="payload-processing"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625771    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee7cd08-78cf-4d48-af68-15445516e575" containerName="payload-processing"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625781    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f28548b9-9a19-4326-ab45-9b5610c28ac9" containerName="payload-pre-processing"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625788    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f28548b9-9a19-4326-ab45-9b5610c28ac9" containerName="payload-pre-processing"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625795    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8acd41cb-78cf-4e7b-ac8b-40471889cb4c" containerName="cleanup"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625800    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8acd41cb-78cf-4e7b-ac8b-40471889cb4c" containerName="cleanup"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625807    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" containerName="maas-api"
Sep 15 21:45:40.625817 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625812    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" containerName="maas-api"
Sep 15 21:45:40.626062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625877    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f28548b9-9a19-4326-ab45-9b5610c28ac9" containerName="payload-pre-processing"
Sep 15 21:45:40.626062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625884    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78f5eb7-1953-4459-9e96-2b2fb839ef08" containerName="maas-api"
Sep 15 21:45:40.626062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625890    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee7cd08-78cf-4d48-af68-15445516e575" containerName="payload-processing"
Sep 15 21:45:40.626062 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.625900    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8acd41cb-78cf-4e7b-ac8b-40471889cb4c" containerName="cleanup"
Sep 15 21:45:40.630402 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.630383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:40.633221 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.633194    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:45:40.634385 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.634360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:45:40.636210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.636191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"]
Sep 15 21:45:40.719919 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.719885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.751023 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.750987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq\" (UID: \"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:40.823258 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.823228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.851643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.851610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq\" (UID: \"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:40.852285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.852266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq\" (UID: \"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:40.941726 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:40.941645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:41.220582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:41.220555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"]
Sep 15 21:45:41.222422 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:45:41.222391    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6b74c3_2150_46d5_bcf8_bec96c6dc12c.slice/crio-14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85 WatchSource:0}: Error finding container 14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85: Status 404 returned error can't find the container with id 14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85
Sep 15 21:45:41.616013 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:41.615970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq" event={"ID":"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c","Type":"ContainerStarted","Data":"d99585f1aa124ccee915d07c512176ea7a60b95df4f4272841219d6554a0349e"}
Sep 15 21:45:41.616178 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:41.616037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq" event={"ID":"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c","Type":"ContainerStarted","Data":"14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85"}
Sep 15 21:45:41.634394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:41.634317    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq" podStartSLOduration=1.634300453 podStartE2EDuration="1.634300453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:41.634228875 +0000 UTC m=+2236.038550921" watchObservedRunningTime="2026-09-15 21:45:41.634300453 +0000 UTC m=+2236.038622501"
Sep 15 21:45:41.719368 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:41.719336    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:42.438819 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:42.438765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:42.622986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:42.622926    2560 generic.go:356] "Generic (PLEG): container finished" podID="6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" containerID="d99585f1aa124ccee915d07c512176ea7a60b95df4f4272841219d6554a0349e" exitCode=0
Sep 15 21:45:42.622986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:42.622975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq" event={"ID":"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c","Type":"ContainerDied","Data":"d99585f1aa124ccee915d07c512176ea7a60b95df4f4272841219d6554a0349e"}
Sep 15 21:45:43.133720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:43.133684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:43.758097 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:43.758073    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:43.882333 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:43.882242    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca\") pod \"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c\" (UID: \"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c\") "
Sep 15 21:45:43.882604 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:43.882577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" (UID: "6d6b74c3-2150-46d5-bcf8-bec96c6dc12c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:43.983354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:43.983316    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:44.635280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:44.635245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq" event={"ID":"6d6b74c3-2150-46d5-bcf8-bec96c6dc12c","Type":"ContainerDied","Data":"14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85"}
Sep 15 21:45:44.635280 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:44.635272    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"
Sep 15 21:45:44.635483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:44.635298    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14a74767c48e1bafbd6fa2dcf1f361ee46783b708edce584c0c161a5b2cdab85"
Sep 15 21:45:47.868124 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:47.868093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:50.772125 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:50.772089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:51.418393 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.418359    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:51.424850 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.424812    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"]
Sep 15 21:45:51.427729 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.427705    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3c4dc8-29825145-dwdnh"]
Sep 15 21:45:51.446998 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.446966    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:45:51.447214 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.447187    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" podUID="6db931d3-6140-438b-93c2-f576d122a9fd" containerName="payload-processing" containerID="cri-o://9b9d11d5499d8db6ec097fe1cbc1cad3b27e0141003abe251778769008144eef" gracePeriod=30
Sep 15 21:45:51.456451 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.456422    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:45:51.456673 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.456648    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" podUID="2dd577af-2b37-49b8-9ed5-57982daad8dd" containerName="payload-pre-processing" containerID="cri-o://cfdf8eb3b3c05a8cd44f0f32c67929f9c44e292dd02cb8641de5d4919b88ec5c" gracePeriod=30
Sep 15 21:45:51.490382 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.490356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:51.591474 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.591401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:51.621949 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.621906    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"]
Sep 15 21:45:51.626426 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.626358    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3c4dc8-fdptq"]
Sep 15 21:45:51.657349 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.657312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:51.676672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.676573    2560 generic.go:356] "Generic (PLEG): container finished" podID="2dd577af-2b37-49b8-9ed5-57982daad8dd" containerID="cfdf8eb3b3c05a8cd44f0f32c67929f9c44e292dd02cb8641de5d4919b88ec5c" exitCode=0
Sep 15 21:45:51.676672 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.676653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" event={"ID":"2dd577af-2b37-49b8-9ed5-57982daad8dd","Type":"ContainerDied","Data":"cfdf8eb3b3c05a8cd44f0f32c67929f9c44e292dd02cb8641de5d4919b88ec5c"}
Sep 15 21:45:51.678677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.678649    2560 generic.go:356] "Generic (PLEG): container finished" podID="6db931d3-6140-438b-93c2-f576d122a9fd" containerID="9b9d11d5499d8db6ec097fe1cbc1cad3b27e0141003abe251778769008144eef" exitCode=0
Sep 15 21:45:51.678798 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.678697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" event={"ID":"6db931d3-6140-438b-93c2-f576d122a9fd","Type":"ContainerDied","Data":"9b9d11d5499d8db6ec097fe1cbc1cad3b27e0141003abe251778769008144eef"}
Sep 15 21:45:51.730931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.730908    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:45:51.733780 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.733759    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:45:51.851723 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.851686    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume\") pod \"2dd577af-2b37-49b8-9ed5-57982daad8dd\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") "
Sep 15 21:45:51.852113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.851756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjngh\" (UniqueName: \"kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh\") pod \"2dd577af-2b37-49b8-9ed5-57982daad8dd\" (UID: \"2dd577af-2b37-49b8-9ed5-57982daad8dd\") "
Sep 15 21:45:51.852113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.851835    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume\") pod \"6db931d3-6140-438b-93c2-f576d122a9fd\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") "
Sep 15 21:45:51.852113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.851872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxz7v\" (UniqueName: \"kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v\") pod \"6db931d3-6140-438b-93c2-f576d122a9fd\" (UID: \"6db931d3-6140-438b-93c2-f576d122a9fd\") "
Sep 15 21:45:51.852243 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.852213    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2dd577af-2b37-49b8-9ed5-57982daad8dd" (UID: "2dd577af-2b37-49b8-9ed5-57982daad8dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:51.852292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.852259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6db931d3-6140-438b-93c2-f576d122a9fd" (UID: "6db931d3-6140-438b-93c2-f576d122a9fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:51.853961 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.853921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh" (OuterVolumeSpecName: "kube-api-access-qjngh") pod "2dd577af-2b37-49b8-9ed5-57982daad8dd" (UID: "2dd577af-2b37-49b8-9ed5-57982daad8dd"). InnerVolumeSpecName "kube-api-access-qjngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:51.854075 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.853967    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v" (OuterVolumeSpecName: "kube-api-access-cxz7v") pod "6db931d3-6140-438b-93c2-f576d122a9fd" (UID: "6db931d3-6140-438b-93c2-f576d122a9fd"). InnerVolumeSpecName "kube-api-access-cxz7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:51.953522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.953431    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd577af-2b37-49b8-9ed5-57982daad8dd-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:51.953522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.953466    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjngh\" (UniqueName: \"kubernetes.io/projected/2dd577af-2b37-49b8-9ed5-57982daad8dd-kube-api-access-qjngh\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:51.953522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.953476    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db931d3-6140-438b-93c2-f576d122a9fd-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:51.953522 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:51.953485    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxz7v\" (UniqueName: \"kubernetes.io/projected/6db931d3-6140-438b-93c2-f576d122a9fd-kube-api-access-cxz7v\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:45:52.031089 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.031051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:52.081750 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.081717    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" path="/var/lib/kubelet/pods/6d6b74c3-2150-46d5-bcf8-bec96c6dc12c/volumes"
Sep 15 21:45:52.082048 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.082035    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8acd41cb-78cf-4e7b-ac8b-40471889cb4c" path="/var/lib/kubelet/pods/8acd41cb-78cf-4e7b-ac8b-40471889cb4c/volumes"
Sep 15 21:45:52.145503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.145471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:52.686050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.686013    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"
Sep 15 21:45:52.686246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.686020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp" event={"ID":"6db931d3-6140-438b-93c2-f576d122a9fd","Type":"ContainerDied","Data":"56ef383abef8e640f3b39a189ce15b1ad943c056907a6b34d2780e49987902f5"}
Sep 15 21:45:52.686246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.686150    2560 scope.go:117] "RemoveContainer" containerID="9b9d11d5499d8db6ec097fe1cbc1cad3b27e0141003abe251778769008144eef"
Sep 15 21:45:52.687505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.687438    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"
Sep 15 21:45:52.687505 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.687472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk" event={"ID":"2dd577af-2b37-49b8-9ed5-57982daad8dd","Type":"ContainerDied","Data":"cea34180bd5abc24ac1dd507d23d427d4413e6c9ae7abd93499f4a469620dfbb"}
Sep 15 21:45:52.695414 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.695399    2560 scope.go:117] "RemoveContainer" containerID="cfdf8eb3b3c05a8cd44f0f32c67929f9c44e292dd02cb8641de5d4919b88ec5c"
Sep 15 21:45:52.706081 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.704985    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:45:52.710050 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.710027    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3c4dc8-7655494477-gqsbp"]
Sep 15 21:45:52.720595 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.720567    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:45:52.722680 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.722659    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3c4dc8-7bcbcb5878-kpnjk"]
Sep 15 21:45:52.838241 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:52.838207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:54.082232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:54.082199    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd577af-2b37-49b8-9ed5-57982daad8dd" path="/var/lib/kubelet/pods/2dd577af-2b37-49b8-9ed5-57982daad8dd/volumes"
Sep 15 21:45:54.082581 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:54.082548    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6db931d3-6140-438b-93c2-f576d122a9fd" path="/var/lib/kubelet/pods/6db931d3-6140-438b-93c2-f576d122a9fd/volumes"
Sep 15 21:45:54.354859 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:54.354824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:45:58.056113 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.056080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:58.157597 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.157564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:58.329895 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.329813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:58.690867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.690828    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"]
Sep 15 21:45:58.691205 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691192    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd577af-2b37-49b8-9ed5-57982daad8dd" containerName="payload-pre-processing"
Sep 15 21:45:58.691263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691207    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd577af-2b37-49b8-9ed5-57982daad8dd" containerName="payload-pre-processing"
Sep 15 21:45:58.691263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691221    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db931d3-6140-438b-93c2-f576d122a9fd" containerName="payload-processing"
Sep 15 21:45:58.691263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691226    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db931d3-6140-438b-93c2-f576d122a9fd" containerName="payload-processing"
Sep 15 21:45:58.691263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691236    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" containerName="revoke-keys"
Sep 15 21:45:58.691263 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" containerName="revoke-keys"
Sep 15 21:45:58.691416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691298    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db931d3-6140-438b-93c2-f576d122a9fd" containerName="payload-processing"
Sep 15 21:45:58.691416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691304    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6b74c3-2150-46d5-bcf8-bec96c6dc12c" containerName="revoke-keys"
Sep 15 21:45:58.691416 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.691312    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd577af-2b37-49b8-9ed5-57982daad8dd" containerName="payload-pre-processing"
Sep 15 21:45:58.696174 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.696154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:45:58.699686 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.699661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7fhv\""
Sep 15 21:45:58.699848 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.699823    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:45:58.704332 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.704302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"]
Sep 15 21:45:58.819208 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.819168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j\" (UID: \"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:45:58.920164 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.920122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j\" (UID: \"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:45:58.920841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:58.920817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j\" (UID: \"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:45:59.007049 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.006956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:45:59.276535 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.276505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"]
Sep 15 21:45:59.278367 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:45:59.278332    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ccb392_ed0e_42f1_b3d5_2d4ed467a2f9.slice/crio-fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86 WatchSource:0}: Error finding container fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86: Status 404 returned error can't find the container with id fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86
Sep 15 21:45:59.607931 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.607894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:59.729737 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.729697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j" event={"ID":"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9","Type":"ContainerStarted","Data":"9286ee13c1267b0a1fc448cedc79f94b9daed85a06fd423711c4552cbb7be163"}
Sep 15 21:45:59.729916 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.729762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j" event={"ID":"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9","Type":"ContainerStarted","Data":"fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86"}
Sep 15 21:45:59.746465 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:45:59.746411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j" podStartSLOduration=1.7463966869999998 podStartE2EDuration="1.746396687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:45:59.74411358 +0000 UTC m=+2254.148435627" watchObservedRunningTime="2026-09-15 21:45:59.746396687 +0000 UTC m=+2254.150718766"
Sep 15 21:46:00.302325 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:00.302202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:00.737186 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:00.737151    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" containerID="9286ee13c1267b0a1fc448cedc79f94b9daed85a06fd423711c4552cbb7be163" exitCode=0
Sep 15 21:46:00.737364 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:00.737234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j" event={"ID":"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9","Type":"ContainerDied","Data":"9286ee13c1267b0a1fc448cedc79f94b9daed85a06fd423711c4552cbb7be163"}
Sep 15 21:46:01.868746 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:01.868708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:46:01.948832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:01.948797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca\") pod \"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9\" (UID: \"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9\") "
Sep 15 21:46:01.949203 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:01.949179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" (UID: "a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:02.049914 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:02.049830    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:46:02.749764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:02.749728    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"
Sep 15 21:46:02.749764 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:02.749758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j" event={"ID":"a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9","Type":"ContainerDied","Data":"fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86"}
Sep 15 21:46:02.750022 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:02.749804    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc1dc4fee2447a342fefc0f7921e43d1268bbf8db150014e0e304295e4710f86"
Sep 15 21:46:09.419794 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.419756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:09.463371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.463335    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:46:09.463660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.463606    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" podUID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" containerName="payload-pre-processing" containerID="cri-o://e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c" gracePeriod=30
Sep 15 21:46:09.519598 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.519566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:09.619308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.619276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:09.630042 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.630013    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"]
Sep 15 21:46:09.632862 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.632834    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7c57b6-9gr5j"]
Sep 15 21:46:09.690985 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.690878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:09.721950 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.721914    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:46:09.790232 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.790194    2560 generic.go:356] "Generic (PLEG): container finished" podID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" containerID="e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c" exitCode=0
Sep 15 21:46:09.790436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.790243    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"
Sep 15 21:46:09.790436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.790271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" event={"ID":"83a6fefe-ee5f-46ca-9fd7-91d52be22289","Type":"ContainerDied","Data":"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"}
Sep 15 21:46:09.790436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.790323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p" event={"ID":"83a6fefe-ee5f-46ca-9fd7-91d52be22289","Type":"ContainerDied","Data":"56eabcadb28d5c114b462e1b20cd7d945573b04a3596ed15c7b72f9b5316873d"}
Sep 15 21:46:09.790436 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.790344    2560 scope.go:117] "RemoveContainer" containerID="e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"
Sep 15 21:46:09.799360 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.799343    2560 scope.go:117] "RemoveContainer" containerID="e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"
Sep 15 21:46:09.799641 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:46:09.799624    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c\": container with ID starting with e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c not found: ID does not exist" containerID="e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"
Sep 15 21:46:09.799705 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.799654    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c"} err="failed to get container status \"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c\": rpc error: code = NotFound desc = could not find container \"e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c\": container with ID starting with e16707136c06e75f74f2d6a6424174c2e0a36fb29111f1539f64b6c0fb0e322c not found: ID does not exist"
Sep 15 21:46:09.824055 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.824025    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rdlb\" (UniqueName: \"kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb\") pod \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") "
Sep 15 21:46:09.824189 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.824064    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume\") pod \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\" (UID: \"83a6fefe-ee5f-46ca-9fd7-91d52be22289\") "
Sep 15 21:46:09.824466 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.824441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83a6fefe-ee5f-46ca-9fd7-91d52be22289" (UID: "83a6fefe-ee5f-46ca-9fd7-91d52be22289"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:09.826122 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.826099    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb" (OuterVolumeSpecName: "kube-api-access-7rdlb") pod "83a6fefe-ee5f-46ca-9fd7-91d52be22289" (UID: "83a6fefe-ee5f-46ca-9fd7-91d52be22289"). InnerVolumeSpecName "kube-api-access-7rdlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:09.925640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.925585    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rdlb\" (UniqueName: \"kubernetes.io/projected/83a6fefe-ee5f-46ca-9fd7-91d52be22289-kube-api-access-7rdlb\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:46:09.925640 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:09.925632    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a6fefe-ee5f-46ca-9fd7-91d52be22289-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:46:10.003677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:10.003585    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:10.082029 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:10.081981    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" path="/var/lib/kubelet/pods/a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9/volumes"
Sep 15 21:46:10.106965 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:10.106867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:10.107130 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:10.107089    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:46:10.109259 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:10.109238    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7c57b6-c748c696b-9n27p"]
Sep 15 21:46:12.081485 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:12.081449    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" path="/var/lib/kubelet/pods/83a6fefe-ee5f-46ca-9fd7-91d52be22289/volumes"
Sep 15 21:46:12.256902 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:12.256867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:46:15.930031 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:15.929986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:16.029354 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:16.029316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:16.256479 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:16.256392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:20.762194 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:20.762156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:46:22.114767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:22.114724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:22.179483 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:46:22.179452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:47:26.806813 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:26.806723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:47:40.380411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:40.380375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:47:41.047599 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:41.047564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:47:42.363550 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:42.363512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:47:46.249405 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:46.249372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:47:46.349415 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:47:46.349378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:48:09.447085 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:09.447041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:48:16.386013 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:16.385960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:48:18.759508 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:18.759472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:48:22.512820 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:22.512781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:48:26.326044 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:26.326011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:48:26.331383 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:26.331356    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:48:31.466079 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:31.466040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:48:45.661196 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:45.661155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:48:55.765657 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:48:55.765617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:49:09.056211 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:49:09.056172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:49:10.520233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:49:10.520199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:49:41.454088 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:49:41.454051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:50:25.367734 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:25.367648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:50:26.806516 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:26.806485    2560 scope.go:117] "RemoveContainer" containerID="34c289a41ba9a68258a2031d2af0aaeb9c4bd1103415693832695093747447dc"
Sep 15 21:50:26.815035 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:26.815018    2560 scope.go:117] "RemoveContainer" containerID="36217341e51ce351a6d561f12119564052630222bbdbba72b5c7049c68f88ed1"
Sep 15 21:50:33.259754 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:33.259718    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:50:38.857815 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:38.857778    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:50:47.150059 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150019    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:50:47.150528 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150509    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" containerName="payload-pre-processing"
Sep 15 21:50:47.150605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150532    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" containerName="payload-pre-processing"
Sep 15 21:50:47.150605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150545    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" containerName="revoke-keys"
Sep 15 21:50:47.150605 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150555    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" containerName="revoke-keys"
Sep 15 21:50:47.150758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150667    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ccb392-ed0e-42f1-b3d5-2d4ed467a2f9" containerName="revoke-keys"
Sep 15 21:50:47.150758 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.150683    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a6fefe-ee5f-46ca-9fd7-91d52be22289" containerName="payload-pre-processing"
Sep 15 21:50:47.153841 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.153818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.156844 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.156813    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-b6f6c259-kserve-self-signed-certs\""
Sep 15 21:50:47.165534 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.165512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:50:47.188515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.188492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:50:47.276670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.276802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.276802 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgzh\" (UniqueName: \"kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.276896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.276896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.276896 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.276880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377556 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377700 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgzh\" (UniqueName: \"kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.377867 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.377714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.378071 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.378045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.378149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.378093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.378149 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.378123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.379922 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.379905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.380109 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.380092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.386424 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.386403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgzh\" (UniqueName: \"kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh\") pod \"e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") " pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.462912 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.462853    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:47.735225 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:47.735198    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:50:47.735930 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:50:47.735906    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5f6094_3239_475c_852f_147f1b622cec.slice/crio-71cee3f14e9431d79fb6cf2c72acef2a872a782929a131b3807850c1231b50d8 WatchSource:0}: Error finding container 71cee3f14e9431d79fb6cf2c72acef2a872a782929a131b3807850c1231b50d8: Status 404 returned error can't find the container with id 71cee3f14e9431d79fb6cf2c72acef2a872a782929a131b3807850c1231b50d8
Sep 15 21:50:48.298014 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:48.294672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" event={"ID":"ee5f6094-3239-475c-852f-147f1b622cec","Type":"ContainerStarted","Data":"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"}
Sep 15 21:50:48.298014 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:48.294809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" event={"ID":"ee5f6094-3239-475c-852f-147f1b622cec","Type":"ContainerStarted","Data":"71cee3f14e9431d79fb6cf2c72acef2a872a782929a131b3807850c1231b50d8"}
Sep 15 21:50:48.333894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:48.333837    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" podStartSLOduration=1.333822243 podStartE2EDuration="1.333822243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:50:48.331596146 +0000 UTC m=+2542.735918192" watchObservedRunningTime="2026-09-15 21:50:48.333822243 +0000 UTC m=+2542.738144290"
Sep 15 21:50:49.570500 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:49.570463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:50:52.375329 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:52.375296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:50:57.463413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:57.463369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:57.463910 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:57.463427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:57.475917 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:57.475893    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:50:58.361040 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:50:58.361010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:51:00.156812 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:00.156777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:22.109930 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:22.109891    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:51:22.141409 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:22.141375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:22.638217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:22.638187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:25.171818 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:25.171781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:26.838816 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:26.838785    2560 scope.go:117] "RemoveContainer" containerID="afea1940c68dfeb65acddfeaea38b8b07eb2da008546191decf132a20ca324b8"
Sep 15 21:51:34.461946 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:34.461901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:37.128628 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.128579    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" podUID="ee5f6094-3239-475c-852f-147f1b622cec" containerName="main" containerID="cri-o://ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c" gracePeriod=45
Sep 15 21:51:37.380559 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.380502    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:51:37.507239 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507197    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507274    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcgzh\" (UniqueName: \"kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507325    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507361    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507386    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507431 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir\") pod \"ee5f6094-3239-475c-852f-147f1b622cec\" (UID: \"ee5f6094-3239-475c-852f-147f1b622cec\") "
Sep 15 21:51:37.507684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507474    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home" (OuterVolumeSpecName: "home") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:51:37.507684 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:51:37.507797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:51:37.507797 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507762    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:37.507878 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.507807    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:37.509665 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.509634    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm" (OuterVolumeSpecName: "dshm") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:51:37.509783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.509668    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:51:37.509783 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.509696    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh" (OuterVolumeSpecName: "kube-api-access-mcgzh") pod "ee5f6094-3239-475c-852f-147f1b622cec" (UID: "ee5f6094-3239-475c-852f-147f1b622cec"). InnerVolumeSpecName "kube-api-access-mcgzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:51:37.566018 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.565984    2560 generic.go:356] "Generic (PLEG): container finished" podID="ee5f6094-3239-475c-852f-147f1b622cec" containerID="ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c" exitCode=0
Sep 15 21:51:37.566127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.566034    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"
Sep 15 21:51:37.566127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.566037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" event={"ID":"ee5f6094-3239-475c-852f-147f1b622cec","Type":"ContainerDied","Data":"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"}
Sep 15 21:51:37.566127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.566078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x" event={"ID":"ee5f6094-3239-475c-852f-147f1b622cec","Type":"ContainerDied","Data":"71cee3f14e9431d79fb6cf2c72acef2a872a782929a131b3807850c1231b50d8"}
Sep 15 21:51:37.566127 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.566100    2560 scope.go:117] "RemoveContainer" containerID="ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"
Sep 15 21:51:37.574778 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.574761    2560 scope.go:117] "RemoveContainer" containerID="ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"
Sep 15 21:51:37.575076 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:51:37.575058    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c\": container with ID starting with ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c not found: ID does not exist" containerID="ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"
Sep 15 21:51:37.575136 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.575084    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c"} err="failed to get container status \"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c\": rpc error: code = NotFound desc = could not find container \"ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c\": container with ID starting with ddb8a15e66f324e41a12b1d3e146ecfdb9160354551995544f1e4e88373f8a6c not found: ID does not exist"
Sep 15 21:51:37.603410 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.603385    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:51:37.607106 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.607086    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-b6f6c259-kserve-7899bf4b55-kss9x"]
Sep 15 21:51:37.609237 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.609214    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcgzh\" (UniqueName: \"kubernetes.io/projected/ee5f6094-3239-475c-852f-147f1b622cec-kube-api-access-mcgzh\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:37.609310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.609239    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5f6094-3239-475c-852f-147f1b622cec-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:37.609310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.609254    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:37.609310 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:37.609265    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5f6094-3239-475c-852f-147f1b622cec-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:38.082207 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:38.082166    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5f6094-3239-475c-852f-147f1b622cec" path="/var/lib/kubelet/pods/ee5f6094-3239-475c-852f-147f1b622cec/volumes"
Sep 15 21:51:41.556671 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.556634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:41.756119 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.756087    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:41.756488 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.756453    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5f6094-3239-475c-852f-147f1b622cec" containerName="main"
Sep 15 21:51:41.756488 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.756467    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5f6094-3239-475c-852f-147f1b622cec" containerName="main"
Sep 15 21:51:41.756579 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.756528    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5f6094-3239-475c-852f-147f1b622cec" containerName="main"
Sep 15 21:51:41.760663 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.760645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.764549 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.764525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 21:51:41.764666 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.764604    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 21:51:41.764731 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.764677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:51:41.764835 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.764820    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vzmv2\""
Sep 15 21:51:41.764898 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.764884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 21:51:41.780680 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.780646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:41.846342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.846239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.846342 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.846289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t65b5\" (UniqueName: \"kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.846546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.846395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.846546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.846466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.947285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.947250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.947539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.947301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.947539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.947359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.947539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.947383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t65b5\" (UniqueName: \"kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.947880 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.947853    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.949767 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.949737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.949863 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.949785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:41.956057 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:41.956037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t65b5\" (UniqueName: \"kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5\") pod \"maas-api-74c7fc967-rck59\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") " pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:42.074720 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:42.074688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:42.353415 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:42.353384    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:42.354777 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:51:42.354750    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda841f779_f0bb_4baa_bfd5_2c4cd0a2b8a4.slice/crio-907de781b06fb6f917184ab46bcd989590aeb977164d9c7eef00adee9dfaa139 WatchSource:0}: Error finding container 907de781b06fb6f917184ab46bcd989590aeb977164d9c7eef00adee9dfaa139: Status 404 returned error can't find the container with id 907de781b06fb6f917184ab46bcd989590aeb977164d9c7eef00adee9dfaa139
Sep 15 21:51:42.356101 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:42.356082    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:51:42.594753 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:42.594665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" event={"ID":"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4","Type":"ContainerStarted","Data":"907de781b06fb6f917184ab46bcd989590aeb977164d9c7eef00adee9dfaa139"}
Sep 15 21:51:43.601411 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:43.601376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" event={"ID":"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4","Type":"ContainerStarted","Data":"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"}
Sep 15 21:51:43.601795 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:43.601435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:43.628708 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:43.628644    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" podStartSLOduration=2.034751788 podStartE2EDuration="2.628628563s" totalImagesPullingTime="593.876775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:51:43.62721854 +0000 UTC m=+2598.031540585" watchObservedRunningTime="2026-09-15 21:51:43.628628563 +0000 UTC m=+2598.032950609"
Sep 15 21:51:49.058588 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.058508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:49.611560 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.611529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:49.645158 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.645120    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:49.645405 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.645347    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" podUID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" containerName="maas-api" containerID="cri-o://67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341" gracePeriod=30
Sep 15 21:51:49.687602 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.687570    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"]
Sep 15 21:51:49.690957 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.690923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.707792 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.707768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"]
Sep 15 21:51:49.811552 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.811523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g98t\" (UniqueName: \"kubernetes.io/projected/eb1d36b9-199c-4663-90c2-0ce04a68f82e-kube-api-access-6g98t\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.811698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.811577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-maas-api-tls\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.811698 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.811652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-metrics-certs\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.811853 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.811758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1d36b9-199c-4663-90c2-0ce04a68f82e-openshift-service-ca\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.884285 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.884262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:49.913080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.913052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g98t\" (UniqueName: \"kubernetes.io/projected/eb1d36b9-199c-4663-90c2-0ce04a68f82e-kube-api-access-6g98t\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.913175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.913093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-maas-api-tls\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.913175 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.913123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-metrics-certs\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.913250 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.913178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1d36b9-199c-4663-90c2-0ce04a68f82e-openshift-service-ca\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.913866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.913836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1d36b9-199c-4663-90c2-0ce04a68f82e-openshift-service-ca\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.915407 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.915386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-metrics-certs\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.915498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.915471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1d36b9-199c-4663-90c2-0ce04a68f82e-maas-api-tls\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:49.925669 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:49.925636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g98t\" (UniqueName: \"kubernetes.io/projected/eb1d36b9-199c-4663-90c2-0ce04a68f82e-kube-api-access-6g98t\") pod \"maas-api-74dc4c8bc5-58s8z\" (UID: \"eb1d36b9-199c-4663-90c2-0ce04a68f82e\") " pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:50.014219 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.014195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls\") pod \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") "
Sep 15 21:51:50.014339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.014224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs\") pod \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") "
Sep 15 21:51:50.014339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.014247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t65b5\" (UniqueName: \"kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5\") pod \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") "
Sep 15 21:51:50.014339 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.014304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca\") pod \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\" (UID: \"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4\") "
Sep 15 21:51:50.014692 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.014669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" (UID: "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:51:50.016210 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.016186    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5" (OuterVolumeSpecName: "kube-api-access-t65b5") pod "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" (UID: "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4"). InnerVolumeSpecName "kube-api-access-t65b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:51:50.016286 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.016246    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" (UID: "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:51:50.016286 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.016265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" (UID: "a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:51:50.036504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.036483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:50.115614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.115561    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-maas-api-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:50.115614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.115583    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-metrics-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:50.115614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.115592    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t65b5\" (UniqueName: \"kubernetes.io/projected/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-kube-api-access-t65b5\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:50.115614 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.115601    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4-openshift-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 21:51:50.311761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.311732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"]
Sep 15 21:51:50.313707 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:51:50.313674    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1d36b9_199c_4663_90c2_0ce04a68f82e.slice/crio-4c12d129a476bc15cd2ee2317efbd1b9d7d42f2fb949d54a3a330322a8471d35 WatchSource:0}: Error finding container 4c12d129a476bc15cd2ee2317efbd1b9d7d42f2fb949d54a3a330322a8471d35: Status 404 returned error can't find the container with id 4c12d129a476bc15cd2ee2317efbd1b9d7d42f2fb949d54a3a330322a8471d35
Sep 15 21:51:50.641704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.641671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z" event={"ID":"eb1d36b9-199c-4663-90c2-0ce04a68f82e","Type":"ContainerStarted","Data":"4c12d129a476bc15cd2ee2317efbd1b9d7d42f2fb949d54a3a330322a8471d35"}
Sep 15 21:51:50.642842 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.642818    2560 generic.go:356] "Generic (PLEG): container finished" podID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" containerID="67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341" exitCode=0
Sep 15 21:51:50.643015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.642863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" event={"ID":"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4","Type":"ContainerDied","Data":"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"}
Sep 15 21:51:50.643015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.642871    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59"
Sep 15 21:51:50.643015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.642894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74c7fc967-rck59" event={"ID":"a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4","Type":"ContainerDied","Data":"907de781b06fb6f917184ab46bcd989590aeb977164d9c7eef00adee9dfaa139"}
Sep 15 21:51:50.643015 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.642914    2560 scope.go:117] "RemoveContainer" containerID="67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"
Sep 15 21:51:50.651769 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.651602    2560 scope.go:117] "RemoveContainer" containerID="67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"
Sep 15 21:51:50.651860 ip-10-0-137-138 kubenswrapper[2560]: E0915 21:51:50.651840    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341\": container with ID starting with 67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341 not found: ID does not exist" containerID="67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"
Sep 15 21:51:50.651903 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.651868    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341"} err="failed to get container status \"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341\": rpc error: code = NotFound desc = could not find container \"67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341\": container with ID starting with 67ffdddb44c7d55828910d9217bd42e00f15a8a155cadb1c18f8419c363d6341 not found: ID does not exist"
Sep 15 21:51:50.662394 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.662374    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:50.666747 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:50.666726    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-74c7fc967-rck59"]
Sep 15 21:51:51.649217 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:51.649180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z" event={"ID":"eb1d36b9-199c-4663-90c2-0ce04a68f82e","Type":"ContainerStarted","Data":"ebbf1116977c8b17f4ae656171fc868a06cb485edf9271b062633e1cef23fdb5"}
Sep 15 21:51:51.649658 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:51.649340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:51:51.671054 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:51.671009    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z" podStartSLOduration=2.205729252 podStartE2EDuration="2.670996512s" totalImagesPullingTime="465.26726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:51:51.66833516 +0000 UTC m=+2606.072657209" watchObservedRunningTime="2026-09-15 21:51:51.670996512 +0000 UTC m=+2606.075318558"
Sep 15 21:51:52.081786 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:52.081692    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" path="/var/lib/kubelet/pods/a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4/volumes"
Sep 15 21:51:54.556670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:54.556634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:51:57.661575 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:51:57.661545    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74dc4c8bc5-58s8z"
Sep 15 21:52:00.656832 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:00.656792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:52:06.956209 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:06.956175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-pc669"]
Sep 15 21:52:10.103674 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:10.103644    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5479646565-vtttt_f20a2845-0c22-486e-9384-6d0379e30731/authorino/0.log"
Sep 15 21:52:16.207498 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:16.207467    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546ffd48db-zqnt9_c7beb9f3-3ea5-4ff1-9263-7806b545ea10/copy-manifests/0.log"
Sep 15 21:52:16.219983 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:16.219953    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546ffd48db-zqnt9_c7beb9f3-3ea5-4ff1-9263-7806b545ea10/manager/0.log"
Sep 15 21:52:16.575757 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:16.575657    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74dc4c8bc5-58s8z_eb1d36b9-199c-4663-90c2-0ce04a68f82e/maas-api/0.log"
Sep 15 21:52:17.766865 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:17.766838    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5479646565-vtttt_f20a2845-0c22-486e-9384-6d0379e30731/authorino/0.log"
Sep 15 21:52:18.097986 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:18.097885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6lklj_4c479125-0a12-4100-bf67-4af100781ac2/kuadrant-console-plugin/0.log"
Sep 15 21:52:18.350335 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:18.350310    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-pc669_739f1027-baf4-416b-974c-219808746926/limitador/0.log"
Sep 15 21:52:19.182064 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:19.182037    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695d9b6867-tlkpz_dcbbeb89-a80b-4b14-858e-8da12f90b324/kube-auth-proxy/0.log"
Sep 15 21:52:19.655661 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:19.655630    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c7c9d6-qrjlt_00a6e246-d23d-403c-91bf-9f7b649e7930/router/0.log"
Sep 15 21:52:20.645646 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:20.645616    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-skd22_106974c6-8e8a-4a41-8c33-e8565cef837f/main/0.log"
Sep 15 21:52:25.816190 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.816153    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sggc6/must-gather-5ntph"]
Sep 15 21:52:25.816546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.816516    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" containerName="maas-api"
Sep 15 21:52:25.816546 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.816531    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" containerName="maas-api"
Sep 15 21:52:25.816618 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.816604    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a841f779-f0bb-4baa-bfd5-2c4cd0a2b8a4" containerName="maas-api"
Sep 15 21:52:25.820833 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.820803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:25.824858 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.824832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sggc6\"/\"openshift-service-ca.crt\""
Sep 15 21:52:25.825034 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.824971    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sggc6\"/\"kube-root-ca.crt\""
Sep 15 21:52:25.825319 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.825304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sggc6\"/\"default-dockercfg-zzzv5\""
Sep 15 21:52:25.832871 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.832847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sggc6/must-gather-5ntph"]
Sep 15 21:52:25.859716 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.859681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:25.923297 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.923270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2c9h\" (UniqueName: \"kubernetes.io/projected/21dff973-98c3-4707-877e-f8a52cae7817-kube-api-access-x2c9h\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:25.923413 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.923325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dff973-98c3-4707-877e-f8a52cae7817-must-gather-output\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:25.958760 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:25.958726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:26.024536 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.024513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dff973-98c3-4707-877e-f8a52cae7817-must-gather-output\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:26.024660 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.024604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2c9h\" (UniqueName: \"kubernetes.io/projected/21dff973-98c3-4707-877e-f8a52cae7817-kube-api-access-x2c9h\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:26.024857 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.024836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dff973-98c3-4707-877e-f8a52cae7817-must-gather-output\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:26.033970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.033949    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sggc6\"/\"kube-root-ca.crt\""
Sep 15 21:52:26.044970 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.044954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sggc6\"/\"openshift-service-ca.crt\""
Sep 15 21:52:26.055538 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.055522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2c9h\" (UniqueName: \"kubernetes.io/projected/21dff973-98c3-4707-877e-f8a52cae7817-kube-api-access-x2c9h\") pod \"must-gather-5ntph\" (UID: \"21dff973-98c3-4707-877e-f8a52cae7817\") " pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:26.135452 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.135432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sggc6\"/\"default-dockercfg-zzzv5\""
Sep 15 21:52:26.142682 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.142666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sggc6/must-gather-5ntph"
Sep 15 21:52:26.429523 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:52:26.429493    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21dff973_98c3_4707_877e_f8a52cae7817.slice/crio-5fa9ce66990556622ba80e56f8aec5077b818e1db242a297eb8485483f4e2d4a WatchSource:0}: Error finding container 5fa9ce66990556622ba80e56f8aec5077b818e1db242a297eb8485483f4e2d4a: Status 404 returned error can't find the container with id 5fa9ce66990556622ba80e56f8aec5077b818e1db242a297eb8485483f4e2d4a
Sep 15 21:52:26.429901 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.429877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sggc6/must-gather-5ntph"]
Sep 15 21:52:26.836947 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.836852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sggc6/must-gather-5ntph" event={"ID":"21dff973-98c3-4707-877e-f8a52cae7817","Type":"ContainerStarted","Data":"5fa9ce66990556622ba80e56f8aec5077b818e1db242a297eb8485483f4e2d4a"}
Sep 15 21:52:26.863617 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.863586    2560 scope.go:117] "RemoveContainer" containerID="9286ee13c1267b0a1fc448cedc79f94b9daed85a06fd423711c4552cbb7be163"
Sep 15 21:52:26.871825 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:26.871806    2560 scope.go:117] "RemoveContainer" containerID="d99585f1aa124ccee915d07c512176ea7a60b95df4f4272841219d6554a0349e"
Sep 15 21:52:27.845882 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:27.845831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sggc6/must-gather-5ntph" event={"ID":"21dff973-98c3-4707-877e-f8a52cae7817","Type":"ContainerStarted","Data":"a0efdf86b64e2eba93331c8c2314fa1df65c218c7d482ebe7abeb46b465d9511"}
Sep 15 21:52:27.846308 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:27.845902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sggc6/must-gather-5ntph" event={"ID":"21dff973-98c3-4707-877e-f8a52cae7817","Type":"ContainerStarted","Data":"819dd8ecaf6c127a90c5502b1c11f4b4eab604ff72c56563c1921a8cc048e8fd"}
Sep 15 21:52:27.867539 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:27.867060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sggc6/must-gather-5ntph" podStartSLOduration=2.098483405 podStartE2EDuration="2.867039881s" totalImagesPullingTime="768.556476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:27.866402021 +0000 UTC m=+2642.270724068" watchObservedRunningTime="2026-09-15 21:52:27.867039881 +0000 UTC m=+2642.271361928"
Sep 15 21:52:28.840515 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:28.840482    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2sps5_fa798427-090b-45b1-89e4-1f85583f438d/global-pull-secret-syncer/0.log"
Sep 15 21:52:28.983836 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:28.983807    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log"
Sep 15 21:52:29.082711 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:29.082681    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-138.ec2.internal_d5fe63d2e1dec62eab5d7d2258fa34d2/haproxy/0.log"
Sep 15 21:52:33.513188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:33.513151    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5479646565-vtttt_f20a2845-0c22-486e-9384-6d0379e30731/authorino/0.log"
Sep 15 21:52:33.699385 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:33.699291    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6lklj_4c479125-0a12-4100-bf67-4af100781ac2/kuadrant-console-plugin/0.log"
Sep 15 21:52:33.799093 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:33.798880    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-pc669_739f1027-baf4-416b-974c-219808746926/limitador/0.log"
Sep 15 21:52:35.314271 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.314233    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/alertmanager/0.log"
Sep 15 21:52:35.341395 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.341367    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/config-reloader/0.log"
Sep 15 21:52:35.375606 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.375558    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/kube-rbac-proxy-web/0.log"
Sep 15 21:52:35.429183 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.429150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/kube-rbac-proxy/0.log"
Sep 15 21:52:35.474580 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.474554    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/kube-rbac-proxy-metric/0.log"
Sep 15 21:52:35.522154 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.522126    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/prom-label-proxy/0.log"
Sep 15 21:52:35.564667 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.564562    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc5e85b3-9bb9-4934-843a-1e0bfa88ddd6/init-config-reloader/0.log"
Sep 15 21:52:35.720704 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.720675    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-l8nw6_5b197dda-05f7-456c-9675-0f873078b9b9/kube-state-metrics/0.log"
Sep 15 21:52:35.801587 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.801560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-l8nw6_5b197dda-05f7-456c-9675-0f873078b9b9/kube-rbac-proxy-main/0.log"
Sep 15 21:52:35.859032 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.859006    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-l8nw6_5b197dda-05f7-456c-9675-0f873078b9b9/kube-rbac-proxy-self/0.log"
Sep 15 21:52:35.984371 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:35.984343    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-rdxtt_af1beee8-f7c6-483f-9caf-ae7131df5bf5/monitoring-plugin/0.log"
Sep 15 21:52:36.275828 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.275741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmr4q_f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1/node-exporter/0.log"
Sep 15 21:52:36.308374 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.308348    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmr4q_f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1/kube-rbac-proxy/0.log"
Sep 15 21:52:36.339695 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.339665    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmr4q_f5a22714-f5c9-4f1a-b35b-386e2d0fc8a1/init-textfile/0.log"
Sep 15 21:52:36.899236 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.899200    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5458b59669-xgm5f_f640e9a6-d515-41f5-9af4-3a83efdf6fc2/telemeter-client/0.log"
Sep 15 21:52:36.937670 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.937589    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5458b59669-xgm5f_f640e9a6-d515-41f5-9af4-3a83efdf6fc2/reload/0.log"
Sep 15 21:52:36.981080 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:36.981042    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5458b59669-xgm5f_f640e9a6-d515-41f5-9af4-3a83efdf6fc2/kube-rbac-proxy/0.log"
Sep 15 21:52:38.686740 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.686700    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"]
Sep 15 21:52:38.690897 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.690866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.702572 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.702536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"]
Sep 15 21:52:38.766643 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.766601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-lib-modules\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.766894 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.766872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-podres\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.767051 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.767034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-proc\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.767186 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.767173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-sys\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.767298 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.767283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqp2\" (UniqueName: \"kubernetes.io/projected/5f490add-6fa8-4b10-a49f-bf93642e0ef7-kube-api-access-nlqp2\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869006 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.868955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-lib-modules\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-podres\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-proc\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-sys\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869188 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqp2\" (UniqueName: \"kubernetes.io/projected/5f490add-6fa8-4b10-a49f-bf93642e0ef7-kube-api-access-nlqp2\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869582 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-lib-modules\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-podres\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869747 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-proc\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.869811 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.869758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f490add-6fa8-4b10-a49f-bf93642e0ef7-sys\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:38.879510 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:38.879474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqp2\" (UniqueName: \"kubernetes.io/projected/5f490add-6fa8-4b10-a49f-bf93642e0ef7-kube-api-access-nlqp2\") pod \"perf-node-gather-daemonset-kzz8m\" (UID: \"5f490add-6fa8-4b10-a49f-bf93642e0ef7\") " pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:39.010860 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.010774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:39.090467 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.090382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/2.log"
Sep 15 21:52:39.096611 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.096525    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-sl8vh_379493e1-5577-4f36-bb77-89dbc4f8d352/console-operator/3.log"
Sep 15 21:52:39.302735 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.302696    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"]
Sep 15 21:52:39.303710 ip-10-0-137-138 kubenswrapper[2560]: W0915 21:52:39.303675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f490add_6fa8_4b10_a49f_bf93642e0ef7.slice/crio-209ddb1af8cb6c97520c5f1af7630e1fa973508f9a3448e576973cad69794d77 WatchSource:0}: Error finding container 209ddb1af8cb6c97520c5f1af7630e1fa973508f9a3448e576973cad69794d77: Status 404 returned error can't find the container with id 209ddb1af8cb6c97520c5f1af7630e1fa973508f9a3448e576973cad69794d77
Sep 15 21:52:39.659246 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.659212    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d564cfd4d-t459t_3012b8e4-61d0-4abb-91e3-4fb62a89464d/console/0.log"
Sep 15 21:52:39.693761 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.693726    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-qkrt6_90b78359-d892-476a-81b8-9da6b8b8afae/download-server/0.log"
Sep 15 21:52:39.941257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.941159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m" event={"ID":"5f490add-6fa8-4b10-a49f-bf93642e0ef7","Type":"ContainerStarted","Data":"34b25ed263e97feafae434dc68f02c215ea8662352755ec440f09a5b4568e9fd"}
Sep 15 21:52:39.941257 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.941233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m" event={"ID":"5f490add-6fa8-4b10-a49f-bf93642e0ef7","Type":"ContainerStarted","Data":"209ddb1af8cb6c97520c5f1af7630e1fa973508f9a3448e576973cad69794d77"}
Sep 15 21:52:39.941555 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.941427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:39.962677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:39.962611    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m" podStartSLOduration=1.9625907649999998 podStartE2EDuration="1.962590765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:52:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:39.958118412 +0000 UTC m=+2654.362440459" watchObservedRunningTime="2026-09-15 21:52:39.962590765 +0000 UTC m=+2654.366912810"
Sep 15 21:52:41.450583 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:41.450555    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgtzk_361ced3c-80ec-46da-b412-3f13aa982c46/dns/0.log"
Sep 15 21:52:41.472179 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:41.472146    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgtzk_361ced3c-80ec-46da-b412-3f13aa982c46/kube-rbac-proxy/0.log"
Sep 15 21:52:41.494453 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:41.494427    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzd2b_3fe068b6-cc5f-4b7a-83ee-e24fdc88fb8b/dns-node-resolver/0.log"
Sep 15 21:52:42.072346 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:42.072313    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55tj8_095bf5ce-872e-4af2-8788-b244fddf4634/node-ca/0.log"
Sep 15 21:52:43.815292 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:43.815259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:43.915866 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:43.915833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gvnl_d5f6d62e-ae03-48c1-a87d-e0049652442b/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:43.943608 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:43.943578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695d9b6867-tlkpz_dcbbeb89-a80b-4b14-858e-8da12f90b324/kube-auth-proxy/0.log"
Sep 15 21:52:44.111161 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:44.111131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c7c9d6-qrjlt_00a6e246-d23d-403c-91bf-9f7b649e7930/router/0.log"
Sep 15 21:52:45.058020 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.057948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9622_08455511-d79f-4864-a164-e7609da524bd/serve-healthcheck-canary/0.log"
Sep 15 21:52:45.524612 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.524577    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lhfh5_deb8d311-ea1d-4355-97b5-4d50b7bb9d36/insights-operator/0.log"
Sep 15 21:52:45.525503 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.525478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lhfh5_deb8d311-ea1d-4355-97b5-4d50b7bb9d36/insights-operator/1.log"
Sep 15 21:52:45.638677 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.638642    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hn7xp_ade8a6ca-4529-4353-a7e9-5648e2199793/kube-rbac-proxy/0.log"
Sep 15 21:52:45.661425 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.661401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hn7xp_ade8a6ca-4529-4353-a7e9-5648e2199793/exporter/0.log"
Sep 15 21:52:45.683506 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.683480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hn7xp_ade8a6ca-4529-4353-a7e9-5648e2199793/extractor/0.log"
Sep 15 21:52:45.959420 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:45.959387    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sggc6/perf-node-gather-daemonset-kzz8m"
Sep 15 21:52:48.821615 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:48.821544    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546ffd48db-zqnt9_c7beb9f3-3ea5-4ff1-9263-7806b545ea10/manager/0.log"
Sep 15 21:52:48.841302 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:48.841280    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546ffd48db-zqnt9_c7beb9f3-3ea5-4ff1-9263-7806b545ea10/copy-manifests/0.log"
Sep 15 21:52:49.327504 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:49.327472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695d9b6867-tlkpz_dcbbeb89-a80b-4b14-858e-8da12f90b324/kube-auth-proxy/0.log"
Sep 15 21:52:49.453141 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:49.453110    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c7c9d6-qrjlt_00a6e246-d23d-403c-91bf-9f7b649e7930/router/0.log"
Sep 15 21:52:50.133927 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:50.133843    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68888cf94f-p6s7f_0bc045c0-829f-40b1-ab53-e5e9b1901428/manager/0.log"
Sep 15 21:52:51.871835 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:51.871805    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695d9b6867-tlkpz_dcbbeb89-a80b-4b14-858e-8da12f90b324/kube-auth-proxy/0.log"
Sep 15 21:52:51.977233 ip-10-0-137-138 kubenswrapper[2560]: I0915 21:52:51.977200    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c7c9d6-qrjlt_00a6e246-d23d-403c-91bf-9f7b649e7930/router/0.log"