Sep 17 01:19:58.317016 ip-10-0-136-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 01:19:58.317029 ip-10-0-136-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 01:19:58.317038 ip-10-0-136-54 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 01:19:58.317369 ip-10-0-136-54 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 01:20:08.196864 ip-10-0-136-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 01:20:08.196879 ip-10-0-136-54 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 22a9c5d489d84922b3e3da23253da849 --
Sep 17 01:21:41.249103 ip-10-0-136-54 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 01:21:41.605704 ip-10-0-136-54 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:21:41.605704 ip-10-0-136-54 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 01:21:41.605704 ip-10-0-136-54 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:21:41.605704 ip-10-0-136-54 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 01:21:41.605704 ip-10-0-136-54 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:21:41.608586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.608498    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 01:21:41.613494 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613478    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.613494 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613495    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613499    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613502    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613506    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613509    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613512    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613515    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613518    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613522    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613526    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613529    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613532    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613535    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613540    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613544    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613547    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613550    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613553    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613557    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.613582 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613560    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613563    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613566    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613568    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613571    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613574    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613577    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613579    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613582    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613584    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613587    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613590    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613593    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613596    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613598    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613601    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613603    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613606    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613608    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613611    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.614054 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613613    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613616    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613619    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613622    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613624    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613627    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613629    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613631    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613634    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613636    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613639    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613641    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613645    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613648    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613651    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613654    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613656    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613659    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613661    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.614539 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613664    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613666    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613669    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613671    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613674    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613678    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613681    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613684    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613687    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613689    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613692    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613695    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613697    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613700    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613702    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613705    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613708    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613710    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613713    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613715    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.615007 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613718    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613720    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613722    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613725    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613727    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613730    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613733    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613736    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613739    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613742    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613744    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613747    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613749    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613752    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613754    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613757    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613759    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613762    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613765    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.613767    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.615497 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614456    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614463    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614466    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614469    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614472    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614475    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614478    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614480    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614485    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614490    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614493    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614496    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614498    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614501    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614503    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614506    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614509    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614512    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614516    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.615986 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614520    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614524    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614527    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614530    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614533    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614535    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614538    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614541    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614544    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614547    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614550    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614553    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614555    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614558    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614560    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614563    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614565    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614568    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614570    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614573    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.616462 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614575    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614578    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614581    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614584    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614587    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614589    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614592    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614594    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614597    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614599    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614602    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614606    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614608    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614611    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614613    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614616    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614618    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614621    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614624    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.616965 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614626    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614630    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614633    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614636    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614639    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614641    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614644    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614647    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614650    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614652    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614655    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614658    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614660    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614663    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614666    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614668    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614671    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614674    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614677    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614680    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.617438 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614682    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614684    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614687    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614690    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614693    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614695    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614698    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614700    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614703    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614705    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614708    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614710    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614713    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614715    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614718    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614720    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614725    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614728    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614730    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614733    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.617953 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.614735    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615096    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615102    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615104    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615107    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615110    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615112    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615115    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615117    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615120    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615123    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615125    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615128    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615131    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615134    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615136    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615139    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615141    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615144    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615147    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.618465 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615149    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615152    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615154    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615157    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615159    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615162    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615164    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615167    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615172    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615174    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615177    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615179    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615182    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615184    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615187    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615189    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615192    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615194    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615197    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615199    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.618973 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615202    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615205    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615211    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615213    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615216    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615219    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615222    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615224    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615227    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615230    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615232    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615235    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615237    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615240    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615242    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615245    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615248    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615250    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615253    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615255    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.619502 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615259    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615262    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615264    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615267    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615269    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615272    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615275    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615277    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615280    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615282    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615285    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615287    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615298    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615301    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615303    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615307    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615310    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615312    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615316    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615319    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.620085 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615322    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615325    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615330    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615334    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615337    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615340    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615343    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615346    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615349    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615352    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615354    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615357    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615361    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615363    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615366    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615368    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615372    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615375    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.620579 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615378    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.615381    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615465    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615532    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615541    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615545    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615549    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615552    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615556    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615561    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615565    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615570    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615573    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615577    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615580    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615583    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615586    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615589    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615592    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615595    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615598    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615601    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615604    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615607    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 01:21:41.621076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615611    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615614    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615618    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615622    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615625    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615628    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615631    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615634    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615637    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615640    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615644    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615647    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615650    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615653    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615656    2573 flags.go:64] FLAG: --enable-server="true"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615659    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615667    2573 flags.go:64] FLAG: --event-burst="100"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615671    2573 flags.go:64] FLAG: --event-qps="50"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615673    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615684    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615687    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615691    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615694    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615697    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615700    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 17 01:21:41.621649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615703    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615706    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615709    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615712    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615715    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615718    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615721    2573 flags.go:64] FLAG: --feature-gates=""
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615724    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615727    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615732    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615735    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615738    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615741    2573 flags.go:64] FLAG: --help="false"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615744    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615748    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615750    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615753    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615757    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615760    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615763    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615766    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615780    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615784    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 01:21:41.622260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615787    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615790    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615793    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615797    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615806    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615810    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615813    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615816    2573 flags.go:64] FLAG: --lock-file=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615819    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615827    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615831    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615836    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615839    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615842    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615845    2573 flags.go:64] FLAG: --logging-format="text"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615848    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615851    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615854    2573 flags.go:64] FLAG: --manifest-url=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615858    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615862    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615866    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615870    2573 flags.go:64] FLAG: --max-pods="110"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615872    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615875    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615878    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 01:21:41.622950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615881    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615884    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615887    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615890    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615897    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615900    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615903    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615906    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615909    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615915    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615918    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615922    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615931    2573 flags.go:64] FLAG: --port="10250"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615934    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615937    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021ae19deb5237707"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615940    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615943    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615946    2573 flags.go:64] FLAG: --register-node="true"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615949    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615953    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615956    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615959    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615962    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615966    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615969    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 01:21:41.624048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615973    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615976    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615979    2573 flags.go:64] FLAG: --runonce="false"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615982    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615985    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615988    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615991    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615994    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.615997    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616000    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616003    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616006    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616009    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616012    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616015    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616018    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616021    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616024    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616031    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616034    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616042    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616049    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616052    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616055    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616058    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 01:21:41.625149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616061    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616064    2573 flags.go:64] FLAG: --v="2"
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616068    2573 flags.go:64] FLAG: --version="false"
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616071    2573 flags.go:64] FLAG: --vmodule=""
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616075    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.616078    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616220    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616225    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616228    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616231    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616234    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616236    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616239    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616242    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616245    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616248    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616251    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616253    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616256    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616258    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616261    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616263    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.626284 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616266    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616269    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616271    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616275    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616278    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616280    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616289    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616292    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616294    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616297    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616300    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616302    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616306    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616309    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616312    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616315    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616317    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616320    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616323    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.627280 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616326    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616328    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616331    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616334    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616337    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616339    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616342    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616344    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616347    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616349    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616352    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616355    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616357    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616360    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616363    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616365    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616369    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616372    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616375    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616377    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.627918 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616387    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616390    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616392    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616395    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616399    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616402    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616405    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616408    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616411    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616414    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616417    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616420    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616424    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616427    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616430    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616432    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616435    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616438    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616440    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.628615 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616443    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616445    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616448    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616450    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616453    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616455    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616458    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616460    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616463    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616468    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616470    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616473    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616476    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616478    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616487    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616489    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616492    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616495    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616497    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616500    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.629370 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616503    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616505    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616508    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616510    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.616513    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.617107    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.625896    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.625917    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.625944    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.625957    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626060    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626070    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626074    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626079    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.629980 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626084    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626088    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626092    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626096    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626101    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626105    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626110    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626114    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626118    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626122    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626126    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626131    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626135    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626141    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626147    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626152    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626156    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626161    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626165    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.630392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626169    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626174    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626178    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626182    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626189    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626194    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626211    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626217    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626221    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626226    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626231    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626236    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626240    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626245    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626249    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626254    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626258    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626262    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626266    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626271    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.630869 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626275    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626279    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626283    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626287    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626291    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626295    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626299    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626303    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626307    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626312    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626316    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626320    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626325    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626329    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626333    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626337    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626342    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626346    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626351    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626363    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.631369 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626368    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626372    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626376    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626380    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626384    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626389    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626393    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626398    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626402    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626406    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626410    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626414    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626418    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626422    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626426    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626430    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626434    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626439    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626443    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626447    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.632018 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626451    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626455    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626459    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626463    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626467    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626472    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626476    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626480    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626485    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626488    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626493    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626497    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626509    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626515    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626522    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.632537 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626526    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.626534    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626766    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626792    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626796    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626803    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626809    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626814    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626819    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626825    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626831    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626835    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626840    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626845    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:21:41.633031 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626849    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626853    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626857    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626861    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626866    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626870    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626874    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626878    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626882    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626886    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626890    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626894    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626899    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626903    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626916    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626921    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626932    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626937    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626941    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626945    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:21:41.633378 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626949    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626954    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626958    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626962    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626966    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626972    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626977    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626982    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626987    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626991    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.626996    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627000    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627004    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627008    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627012    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627016    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627020    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627024    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627028    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:21:41.633923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627032    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627036    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627041    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627045    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627049    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627054    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627058    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627062    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627066    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627070    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627084    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627089    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627093    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627097    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627101    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627105    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627109    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627114    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627118    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627122    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:21:41.634386 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627126    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627130    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627135    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627139    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627143    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627147    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627151    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627155    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627159    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627164    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627168    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627172    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627177    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627181    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627185    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627189    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627193    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627197    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627201    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627205    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:21:41.635042 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627210    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627214    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627218    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627229    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627234    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627238    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627242    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:41.627246    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.627254    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.627439    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.631827    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.632719    2573 server.go:1019] "Starting client certificate rotation"
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.632811    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 01:21:41.635552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.632862    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 01:21:41.635982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.635350    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 01:21:41.636473 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.636453    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 01:21:41.647659 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.647642    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 17 01:21:41.651697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.651681    2573 log.go:25] "Validated CRI v1 image API"
Sep 17 01:21:41.652495 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.652479    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 01:21:41.655279 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.655261    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a71d1682-f8f3-4d6c-9bed-8fa3034cc028:/dev/nvme0n1p3 e8fb0357-3d58-420e-9fca-0cf89ba964a6:/dev/nvme0n1p4]
Sep 17 01:21:41.655345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.655278    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 01:21:41.660136 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.659972    2573 manager.go:216] Machine: {Timestamp:2026-09-17 01:21:41.659508697 +0000 UTC m=+0.303616787 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100186 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2171e6640b304bee7e5b520e56844e SystemUUID:ec2171e6-640b-304b-ee7e-5b520e56844e BootID:22a9c5d4-89d8-4922-b3e3-da23253da849 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:cb:fc:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:cb:fc:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:02:ea:a6:fa:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 01:21:41.660136 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.660129    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 01:21:41.660266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.660245    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 01:21:41.660332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.660309    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 01:21:41.661860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.661837    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 01:21:41.662033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.661862    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 01:21:41.663198 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.663186    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 01:21:41.663262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.663205    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 01:21:41.663262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.663217    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 01:21:41.663996 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.663983    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 01:21:41.664925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.664914    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 01:21:41.668871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.668858    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 01:21:41.668998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.668987    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 01:21:41.669063 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669024    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 01:21:41.669063 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669039    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 01:21:41.669063 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669058    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 01:21:41.669187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669072    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 17 01:21:41.669187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669084    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 01:21:41.669527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669505    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 01:21:41.669617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.669556    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 01:21:41.673227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.673208    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 01:21:41.675852 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.675836    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 01:21:41.675929 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.675874    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 01:21:41.677750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677737    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 01:21:41.677830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677756    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 01:21:41.677830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677766    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 01:21:41.677830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677794    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 01:21:41.677830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677807    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 01:21:41.677830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677816    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677835    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677843    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677853    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677861    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677873    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 01:21:41.678005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.677881    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 01:21:41.678483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.678472    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 01:21:41.678537 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.678486    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 01:21:41.680468 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.680446    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 01:21:41.680554 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.680471    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 01:21:41.682236 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.682220    2573 server.go:1268] "Started kubelet"
Sep 17 01:21:41.682338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.682277    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 01:21:41.682394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.682330    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 01:21:41.682435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.682408    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 01:21:41.682827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.682811    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 01:21:41.683011 ip-10-0-136-54 systemd[1]: Started Kubernetes Kubelet.
Sep 17 01:21:41.683861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.683836    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 01:21:41.685454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.685440    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 01:21:41.688172 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.688150    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 01:21:41.691400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.691383    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 01:21:41.691977 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.691956    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 01:21:41.692110 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.691159    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-54.ec2.internal.18d5f71633edac0d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-54.ec2.internal,UID:ip-10-0-136-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-54.ec2.internal,},FirstTimestamp:2026-09-17 01:21:41.682195469 +0000 UTC m=+0.326303540,LastTimestamp:2026-09-17 01:21:41.682195469 +0000 UTC m=+0.326303540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-54.ec2.internal,}"
Sep 17 01:21:41.692110 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.692080    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:41.692682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692569    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 01:21:41.692682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692629    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 01:21:41.692682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692648    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 01:21:41.692966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692712    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 01:21:41.692966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692720    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 01:21:41.692966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692947    2573 factory.go:55] Registering systemd factory
Sep 17 01:21:41.692966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.692957    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 17 01:21:41.693214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693193    2573 factory.go:153] Registering CRI-O factory
Sep 17 01:21:41.693214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693208    2573 factory.go:223] Registration of the crio container factory successfully
Sep 17 01:21:41.693314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693256    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 01:21:41.693314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693273    2573 factory.go:103] Registering Raw factory
Sep 17 01:21:41.693314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693288    2573 manager.go:1196] Started watching for new ooms in manager
Sep 17 01:21:41.693734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.693717    2573 manager.go:349] Starting recovery of all containers
Sep 17 01:21:41.695586 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.695549    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 01:21:41.695710 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.695610    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 01:21:41.704881 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.704857    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcp7x"
Sep 17 01:21:41.706305 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.706284    2573 manager.go:354] Recovery completed
Sep 17 01:21:41.711218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.711132    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.712531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.711876    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcp7x"
Sep 17 01:21:41.713741 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.713719    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.713840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.713754    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.713840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.713786    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.714362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.714346    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 01:21:41.714362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.714359    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 01:21:41.714499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.714360    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.714499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.714378    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 01:21:41.715175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.715161    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.715237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.715185    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.715237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.715195    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.715571 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.715508    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-54.ec2.internal.18d5f71635cef6e4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-54.ec2.internal,UID:ip-10-0-136-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-54.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-54.ec2.internal,},FirstTimestamp:2026-09-17 01:21:41.713737444 +0000 UTC m=+0.357845514,LastTimestamp:2026-09-17 01:21:41.713737444 +0000 UTC m=+0.357845514,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-54.ec2.internal,}"
Sep 17 01:21:41.717306 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.717292    2573 policy_none.go:49] "None policy: Start"
Sep 17 01:21:41.717380 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.717310    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 01:21:41.717380 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.717324    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 01:21:41.719397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.719375    2573 policy_none.go:47] "Start"
Sep 17 01:21:41.744440 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744305    2573 manager.go:337] "Starting Device Plugin manager"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.744455    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744468    2573 server.go:87] "Starting device plugin registration server"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744704    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744717    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744859    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744943    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.744949    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.745557    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 01:21:41.770489 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.745598    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:41.790965 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.790937    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 01:21:41.792287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.792266    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 01:21:41.792376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.792309    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 01:21:41.792376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.792328    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 01:21:41.792469 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.792403    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 01:21:41.794559 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.794542    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:21:41.845160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.845133    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.846015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.846000    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.846097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.846026    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.846097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.846036    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.846097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.846067    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.854256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.854241    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.854351 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.854264    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-54.ec2.internal\": node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:41.877692 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.877631    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:41.892693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.892669    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"]
Sep 17 01:21:41.892746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.892732    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.893627 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.893608    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.893703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.893638    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.893703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.893648    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.895933 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.895920    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.896073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.896134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896093    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.896796 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896767    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.896861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896811    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.896861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896766    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.896861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896828    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.896861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896843    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.896979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.896857    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.899079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.899063    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.899167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.899093    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:21:41.900359 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.900344    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:21:41.900417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.900369    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:21:41.900417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:41.900383    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:21:41.922277 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.922260    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-54.ec2.internal\" not found" node="ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.926545 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.926530    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-54.ec2.internal\" not found" node="ip-10-0-136-54.ec2.internal"
Sep 17 01:21:41.978725 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:41.978707    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.079081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.079047    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.093296 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.093275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.093348 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.093301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.093348 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.093319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f1f42501049c1b81a90668ada60c8b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-54.ec2.internal\" (UID: \"27f1f42501049c1b81a90668ada60c8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.179691 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.179618    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.193897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.193874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.193948 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.193902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.193948 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.193918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f1f42501049c1b81a90668ada60c8b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-54.ec2.internal\" (UID: \"27f1f42501049c1b81a90668ada60c8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.194010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.193967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.194010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.193966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31c75b674bb7296b0e2edd44b2672e07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal\" (UID: \"31c75b674bb7296b0e2edd44b2672e07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.194071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.194009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f1f42501049c1b81a90668ada60c8b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-54.ec2.internal\" (UID: \"27f1f42501049c1b81a90668ada60c8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.224991 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.224973    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.230159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.229956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:42.280074 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.280049    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.380491 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.380458    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.487105 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.487028    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.594727 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.594700    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.632324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.632303    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 01:21:42.632879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.632462    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 01:21:42.694847 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.694818    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.717593 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.717560    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 01:16:42 +0000 UTC" deadline="2028-06-30 18:36:44.582714932 +0000 UTC"
Sep 17 01:21:42.717674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.717590    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15665h15m1.865129453s"
Sep 17 01:21:42.795170 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.795114    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.895297 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.895257    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:42.905362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.905341    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:21:42.965311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:42.965289    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:21:42.995941 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:42.995911    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:43.096743 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.096664    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:43.139687 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:43.139654    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f1f42501049c1b81a90668ada60c8b.slice/crio-5798acc0db580c687fb0714681650a8805e64ee84a136bf3bd50ab888c7a440f WatchSource:0}: Error finding container 5798acc0db580c687fb0714681650a8805e64ee84a136bf3bd50ab888c7a440f: Status 404 returned error can't find the container with id 5798acc0db580c687fb0714681650a8805e64ee84a136bf3bd50ab888c7a440f
Sep 17 01:21:43.139947 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:43.139926    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c75b674bb7296b0e2edd44b2672e07.slice/crio-64f8874694b82d50ef757624b79890fcff42b407316dd0f2eebeb6910d6a158f WatchSource:0}: Error finding container 64f8874694b82d50ef757624b79890fcff42b407316dd0f2eebeb6910d6a158f: Status 404 returned error can't find the container with id 64f8874694b82d50ef757624b79890fcff42b407316dd0f2eebeb6910d6a158f
Sep 17 01:21:43.145658 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.145645    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:21:43.197574 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.197541    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-54.ec2.internal\" not found"
Sep 17 01:21:43.265026 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.265008    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:21:43.294303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.294270    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:43.306713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.306697    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 01:21:43.307762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.307749    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal"
Sep 17 01:21:43.314076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.314062    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 01:21:43.671641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.671608    2573 apiserver.go:52] "Watching apiserver"
Sep 17 01:21:43.678677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.678659    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 01:21:43.679764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.679743    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2sqwh","kube-system/konnectivity-agent-5tbrn","kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p","openshift-dns/node-resolver-h7wvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal","openshift-multus/network-metrics-daemon-85vss","openshift-network-operator/iptables-alerter-jkm9r","openshift-cluster-node-tuning-operator/tuned-qzvgl","openshift-image-registry/node-ca-sm6vk","openshift-multus/multus-6w8sw","openshift-multus/multus-additional-cni-plugins-s2zw4","openshift-network-diagnostics/network-check-target-knzdd","openshift-ovn-kubernetes/ovnkube-node-4vmvk"]
Sep 17 01:21:43.683781 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.683760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.683884 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.683864    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:43.685993 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.685974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.688283 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.688265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.688657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.688465    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 01:21:43.688657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.688563    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gjp8b\""
Sep 17 01:21:43.688657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.688592    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 01:21:43.690663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.690643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:43.690762 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.690706    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:43.691012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.690985    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 01:21:43.691103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.691003    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6bw4x\""
Sep 17 01:21:43.691103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.691033    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 01:21:43.691857 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.691837    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 01:21:43.691970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.691915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 01:21:43.692022 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.691978    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.692067 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.692054    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.692578 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.692560    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 01:21:43.693309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.693279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.695486 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.695459    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.695602 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.695528    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ctm22\""
Sep 17 01:21:43.695689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.695673    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 01:21:43.695749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.695685    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 01:21:43.695797 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.695757    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.696050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.696028    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.698339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.698318    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.698533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.698513    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 01:21:43.698947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.698925    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.699029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.699004    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.699254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.699232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nwrkj\""
Sep 17 01:21:43.701016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.700872    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.701136 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.701104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.701452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.701430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.701591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.701575    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27bw4\""
Sep 17 01:21:43.702039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702017    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 01:21:43.702583 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-var-lib-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.702678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-netd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.702678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.702678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-hostroot\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-script-lib\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702766    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-system-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-netns\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2gmd\" (UniqueName: \"kubernetes.io/projected/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-kube-api-access-t2gmd\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.702874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-slash\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-multus-certs\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5fqq\" (UniqueName: \"kubernetes.io/projected/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-kube-api-access-z5fqq\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a88fb2-87c8-48c9-ba3f-b9111796aba1-agent-certs\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.702969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-socket-dir-parent\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-bin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-multus\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-kubelet\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-systemd-units\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-etc-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-ovn\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-node-log\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-config\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a88fb2-87c8-48c9-ba3f-b9111796aba1-konnectivity-ca\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-systemd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-bin\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/854f5ac5-41e0-4854-947a-b91ee72b2676-ovn-node-metrics-cert\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cnibin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703623    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.703763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-conf-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-daemon-config\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-etc-kubernetes\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-netns\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmn4\" (UniqueName: \"kubernetes.io/projected/854f5ac5-41e0-4854-947a-b91ee72b2676-kube-api-access-2jmn4\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.703973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-log-socket\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-env-overrides\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cni-binary-copy\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-k8s-cni-cncf-io\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-kubelet\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.704328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704294    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jrl7k\""
Sep 17 01:21:43.705124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704532    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.705124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.704623    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 01:21:43.706402 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.706384    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.706535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.706516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.707157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.707135    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gmv4r\""
Sep 17 01:21:43.707817 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.707798    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 01:21:43.707928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.707904    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.710034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.709945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 01:21:43.710936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.710918    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 01:21:43.711083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.711062    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mqqq\""
Sep 17 01:21:43.711393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.711364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.713746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.713659    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 01:21:43.713847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.713753    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 01:21:43.713847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.713777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.713962 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.713857    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:43.713962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.713911    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zx65r\""
Sep 17 01:21:43.729337 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.729320    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnttt"
Sep 17 01:21:43.738479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.738459    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnttt"
Sep 17 01:21:43.794325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.794114    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 01:21:43.798634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.798562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal" event={"ID":"31c75b674bb7296b0e2edd44b2672e07","Type":"ContainerStarted","Data":"64f8874694b82d50ef757624b79890fcff42b407316dd0f2eebeb6910d6a158f"}
Sep 17 01:21:43.800315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.800283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal" event={"ID":"27f1f42501049c1b81a90668ada60c8b","Type":"ContainerStarted","Data":"5798acc0db580c687fb0714681650a8805e64ee84a136bf3bd50ab888c7a440f"}
Sep 17 01:21:43.805070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba43f8d-2032-489d-b1cc-36543b391759-tmp-dir\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.805169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.805169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.805169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-env-overrides\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.805342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-k8s-cni-cncf-io\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-kubelet\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-kubelet\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-k8s-cni-cncf-io\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-conf\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs269\" (UniqueName: \"kubernetes.io/projected/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kube-api-access-qs269\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-systemd\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-script-lib\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-netns\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-modprobe-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-netns\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7db90a84-dd5b-404b-bcc1-45a213c48f04-host\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805643    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxf2\" (UniqueName: \"kubernetes.io/projected/4509e74e-a96f-45ec-a4dc-89223bed1c78-kube-api-access-jdxf2\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-kubelet-config\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-env-overrides\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.805774 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-slash\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805860    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-slash\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-kubernetes\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.805995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5fqq\" (UniqueName: \"kubernetes.io/projected/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-kube-api-access-z5fqq\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a88fb2-87c8-48c9-ba3f-b9111796aba1-agent-certs\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-socket-dir-parent\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysconfig\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806132    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-script-lib\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-dbus\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-socket-dir-parent\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-kubelet\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.806317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-kubelet\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-etc-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-etc-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-node-log\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806449    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-node-log\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cnibin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-conf-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmdh\" (UniqueName: \"kubernetes.io/projected/bba43f8d-2032-489d-b1cc-36543b391759-kube-api-access-ctmdh\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cnibin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-iptables-alerter-script\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-bin\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-conf-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-bin\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-daemon-config\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-system-cni-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806703    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 01:21:43.807049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-host-slash\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-netns\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7db90a84-dd5b-404b-bcc1-45a213c48f04-serviceca\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-log-socket\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.806972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cni-binary-copy\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-sys\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-var-lib-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-run-netns\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-var-lib-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-netd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.807179    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-hostroot\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-tuned\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.807260    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:21:44.30722176 +0000 UTC m=+2.951329850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:43.807967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-cni-netd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-hostroot\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-openvswitch\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807417    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-log-socket\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6299t\" (UniqueName: \"kubernetes.io/projected/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-kube-api-access-6299t\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-device-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-system-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2gmd\" (UniqueName: \"kubernetes.io/projected/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-kube-api-access-t2gmd\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-cni-binary-copy\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-tmp\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57zs\" (UniqueName: \"kubernetes.io/projected/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-kube-api-access-l57zs\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-cnibin\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-multus-certs\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.808820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807876    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-run-multus-certs\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-bin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-system-cni-dir\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-multus\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba43f8d-2032-489d-b1cc-36543b391759-hosts-file\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807988    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.807988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-multus-daemon-config\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808011    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-multus\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-systemd-units\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808011    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-host-var-lib-cni-bin\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-ovn\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-systemd-units\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-ovn\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-config\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-etc-kubernetes\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-run\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.809723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-lib-modules\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-var-lib-kubelet\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a88fb2-87c8-48c9-ba3f-b9111796aba1-konnectivity-ca\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808362    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-etc-kubernetes\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-systemd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/854f5ac5-41e0-4854-947a-b91ee72b2676-ovn-node-metrics-cert\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-host\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmn4\" (UniqueName: \"kubernetes.io/projected/854f5ac5-41e0-4854-947a-b91ee72b2676-kube-api-access-2jmn4\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zj4s\" (UniqueName: \"kubernetes.io/projected/7db90a84-dd5b-404b-bcc1-45a213c48f04-kube-api-access-9zj4s\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/854f5ac5-41e0-4854-947a-b91ee72b2676-ovnkube-config\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/854f5ac5-41e0-4854-947a-b91ee72b2676-run-systemd\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.810647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.808906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a88fb2-87c8-48c9-ba3f-b9111796aba1-konnectivity-ca\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.811222 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.811192    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/854f5ac5-41e0-4854-947a-b91ee72b2676-ovn-node-metrics-cert\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.811269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.811236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a88fb2-87c8-48c9-ba3f-b9111796aba1-agent-certs\") pod \"konnectivity-agent-5tbrn\" (UID: \"21a88fb2-87c8-48c9-ba3f-b9111796aba1\") " pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:43.817166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.817146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5fqq\" (UniqueName: \"kubernetes.io/projected/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-kube-api-access-z5fqq\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:43.818867 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.818847    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:43.818962 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.818893    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:43.818962 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.818914    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:43.819085 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.818984    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:44.318966132 +0000 UTC m=+2.963074198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:43.821524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.821501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmn4\" (UniqueName: \"kubernetes.io/projected/854f5ac5-41e0-4854-947a-b91ee72b2676-kube-api-access-2jmn4\") pod \"ovnkube-node-4vmvk\" (UID: \"854f5ac5-41e0-4854-947a-b91ee72b2676\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:43.821597 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.821505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2gmd\" (UniqueName: \"kubernetes.io/projected/9aaaaeb0-ad83-4a1f-aaa9-e584fc804018-kube-api-access-t2gmd\") pod \"multus-6w8sw\" (UID: \"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018\") " pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:43.909422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-sys\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-tuned\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6299t\" (UniqueName: \"kubernetes.io/projected/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-kube-api-access-6299t\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-device-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-sys\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909520    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-tmp\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57zs\" (UniqueName: \"kubernetes.io/projected/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-kube-api-access-l57zs\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-cnibin\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.909638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba43f8d-2032-489d-b1cc-36543b391759-hosts-file\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909683    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-device-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-run\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-lib-modules\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-var-lib-kubelet\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-host\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zj4s\" (UniqueName: \"kubernetes.io/projected/7db90a84-dd5b-404b-bcc1-45a213c48f04-kube-api-access-9zj4s\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba43f8d-2032-489d-b1cc-36543b391759-tmp-dir\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-run\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-conf\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs269\" (UniqueName: \"kubernetes.io/projected/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kube-api-access-qs269\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.909981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bba43f8d-2032-489d-b1cc-36543b391759-hosts-file\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.910370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-systemd\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-modprobe-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7db90a84-dd5b-404b-bcc1-45a213c48f04-host\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxf2\" (UniqueName: \"kubernetes.io/projected/4509e74e-a96f-45ec-a4dc-89223bed1c78-kube-api-access-jdxf2\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-kubelet-config\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910207    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-kubernetes\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-lib-modules\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-cnibin\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysconfig\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-dbus\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmdh\" (UniqueName: \"kubernetes.io/projected/bba43f8d-2032-489d-b1cc-36543b391759-kube-api-access-ctmdh\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.911806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-iptables-alerter-script\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.910470    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-system-cni-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-host-slash\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910520    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysctl-conf\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:43.910533    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:44.410515638 +0000 UTC m=+3.054623702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910567    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910592    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-systemd\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-host\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7db90a84-dd5b-404b-bcc1-45a213c48f04-serviceca\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910652    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4509e74e-a96f-45ec-a4dc-89223bed1c78-system-cni-dir\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910520    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bba43f8d-2032-489d-b1cc-36543b391759-tmp-dir\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-host-slash\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-dbus\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.913033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-modprobe-d\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910876    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-var-lib-kubelet\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-kubelet-config\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7db90a84-dd5b-404b-bcc1-45a213c48f04-host\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.910986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52f4d384-3500-46ed-8500-e5bbc5b16bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-sysconfig\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911039    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-kubernetes\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7db90a84-dd5b-404b-bcc1-45a213c48f04-serviceca\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-iptables-alerter-script\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.911914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4509e74e-a96f-45ec-a4dc-89223bed1c78-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.912516    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-tmp\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.914227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.912537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-etc-tuned\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.920201 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.920181    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs269\" (UniqueName: \"kubernetes.io/projected/52f4d384-3500-46ed-8500-e5bbc5b16bbf-kube-api-access-qs269\") pod \"aws-ebs-csi-driver-node-khc5p\" (UID: \"52f4d384-3500-46ed-8500-e5bbc5b16bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:43.920296 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.920263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57zs\" (UniqueName: \"kubernetes.io/projected/fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856-kube-api-access-l57zs\") pod \"tuned-qzvgl\" (UID: \"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856\") " pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:43.920720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.920697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6299t\" (UniqueName: \"kubernetes.io/projected/83bda2bd-f277-4c81-98c7-a1dd8ad7a50c-kube-api-access-6299t\") pod \"iptables-alerter-jkm9r\" (UID: \"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c\") " pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:43.925231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.925158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxf2\" (UniqueName: \"kubernetes.io/projected/4509e74e-a96f-45ec-a4dc-89223bed1c78-kube-api-access-jdxf2\") pod \"multus-additional-cni-plugins-s2zw4\" (UID: \"4509e74e-a96f-45ec-a4dc-89223bed1c78\") " pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:43.925334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.925271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zj4s\" (UniqueName: \"kubernetes.io/projected/7db90a84-dd5b-404b-bcc1-45a213c48f04-kube-api-access-9zj4s\") pod \"node-ca-sm6vk\" (UID: \"7db90a84-dd5b-404b-bcc1-45a213c48f04\") " pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:43.926954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.926912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmdh\" (UniqueName: \"kubernetes.io/projected/bba43f8d-2032-489d-b1cc-36543b391759-kube-api-access-ctmdh\") pod \"node-resolver-h7wvg\" (UID: \"bba43f8d-2032-489d-b1cc-36543b391759\") " pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:43.997101 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:43.997073    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:21:44.007299 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.007241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:21:44.011886 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.011834    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a88fb2_87c8_48c9_ba3f_b9111796aba1.slice/crio-1a0dc232f335c948c293f1f7c5b48a04c4c8dda9381f67a4d30fd8b4efd7a374 WatchSource:0}: Error finding container 1a0dc232f335c948c293f1f7c5b48a04c4c8dda9381f67a4d30fd8b4efd7a374: Status 404 returned error can't find the container with id 1a0dc232f335c948c293f1f7c5b48a04c4c8dda9381f67a4d30fd8b4efd7a374
Sep 17 01:21:44.016355 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.016330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6w8sw"
Sep 17 01:21:44.023578 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.023548    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854f5ac5_41e0_4854_947a_b91ee72b2676.slice/crio-c4ecc5ab01c516a2511937e1e301ebba43418750b4929e704ad8c6c367040463 WatchSource:0}: Error finding container c4ecc5ab01c516a2511937e1e301ebba43418750b4929e704ad8c6c367040463: Status 404 returned error can't find the container with id c4ecc5ab01c516a2511937e1e301ebba43418750b4929e704ad8c6c367040463
Sep 17 01:21:44.023684 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.023576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jkm9r"
Sep 17 01:21:44.030082 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.030059    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p"
Sep 17 01:21:44.033974 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.033936    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aaaaeb0_ad83_4a1f_aaa9_e584fc804018.slice/crio-44c68c2d895a9af8b29468f81549a251b7907586cd744514f663272c0e02c48a WatchSource:0}: Error finding container 44c68c2d895a9af8b29468f81549a251b7907586cd744514f663272c0e02c48a: Status 404 returned error can't find the container with id 44c68c2d895a9af8b29468f81549a251b7907586cd744514f663272c0e02c48a
Sep 17 01:21:44.037635 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.037475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzvgl"
Sep 17 01:21:44.040008 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.039972    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bda2bd_f277_4c81_98c7_a1dd8ad7a50c.slice/crio-13432c4181b9006285c9b83c5b7873c8358b632f95e0f7d35c31fde301cca01e WatchSource:0}: Error finding container 13432c4181b9006285c9b83c5b7873c8358b632f95e0f7d35c31fde301cca01e: Status 404 returned error can't find the container with id 13432c4181b9006285c9b83c5b7873c8358b632f95e0f7d35c31fde301cca01e
Sep 17 01:21:44.045114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.044901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sm6vk"
Sep 17 01:21:44.046723 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.046684    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f4d384_3500_46ed_8500_e5bbc5b16bbf.slice/crio-fbae7f398b2051cd280dfc309180c3b5fb1788e9193b116fb96f5fcfa97ebd70 WatchSource:0}: Error finding container fbae7f398b2051cd280dfc309180c3b5fb1788e9193b116fb96f5fcfa97ebd70: Status 404 returned error can't find the container with id fbae7f398b2051cd280dfc309180c3b5fb1788e9193b116fb96f5fcfa97ebd70
Sep 17 01:21:44.052518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.052369    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7wvg"
Sep 17 01:21:44.053204 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:21:44.053171    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1ffdd7_52e2_4029_bdde_f0fa8b0e8856.slice/crio-392147ca221a7c22ae1f33da33044244da5ec6a7322912927b78dd03e103a8af WatchSource:0}: Error finding container 392147ca221a7c22ae1f33da33044244da5ec6a7322912927b78dd03e103a8af: Status 404 returned error can't find the container with id 392147ca221a7c22ae1f33da33044244da5ec6a7322912927b78dd03e103a8af
Sep 17 01:21:44.060398 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.060244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2zw4"
Sep 17 01:21:44.112510 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.112485    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:21:44.313521 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.313431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:44.313674 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.313594    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:44.313674 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.313665    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:21:45.313642524 +0000 UTC m=+3.957750597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:44.414924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.414892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:44.415096 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.414972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:44.415096 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415054    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:44.415096 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415095    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:44.415252 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415111    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:44.415252 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415125    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:44.415252 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415127    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:45.415108093 +0000 UTC m=+4.059216168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:44.415252 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:44.415159    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:45.41514876 +0000 UTC m=+4.059256834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:44.741285 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.741242    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 01:16:44 +0000 UTC" deadline="2028-03-05 12:46:08.742522617 +0000 UTC"
Sep 17 01:21:44.741285 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.741283    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12851h24m24.001245479s"
Sep 17 01:21:44.803840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.803778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerStarted","Data":"7fda13dbfdfc810ff93ddc71e4f120b0763dda66d26380ab18ff0378aa29dffc"}
Sep 17 01:21:44.805231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.805196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sm6vk" event={"ID":"7db90a84-dd5b-404b-bcc1-45a213c48f04","Type":"ContainerStarted","Data":"97ba5d8f96cc3abbcdd4ee762ee920c08e814576a6f3de0f3bf22fc4fded4e19"}
Sep 17 01:21:44.806606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.806572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tbrn" event={"ID":"21a88fb2-87c8-48c9-ba3f-b9111796aba1","Type":"ContainerStarted","Data":"1a0dc232f335c948c293f1f7c5b48a04c4c8dda9381f67a4d30fd8b4efd7a374"}
Sep 17 01:21:44.807938 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.807915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7wvg" event={"ID":"bba43f8d-2032-489d-b1cc-36543b391759","Type":"ContainerStarted","Data":"b3ddf211e346047942b574f731ab1b5de10776ef2954708bda52a75d1b087536"}
Sep 17 01:21:44.809224 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.809196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzvgl" event={"ID":"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856","Type":"ContainerStarted","Data":"392147ca221a7c22ae1f33da33044244da5ec6a7322912927b78dd03e103a8af"}
Sep 17 01:21:44.810524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.810502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p" event={"ID":"52f4d384-3500-46ed-8500-e5bbc5b16bbf","Type":"ContainerStarted","Data":"fbae7f398b2051cd280dfc309180c3b5fb1788e9193b116fb96f5fcfa97ebd70"}
Sep 17 01:21:44.811955 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.811929    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jkm9r" event={"ID":"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c","Type":"ContainerStarted","Data":"13432c4181b9006285c9b83c5b7873c8358b632f95e0f7d35c31fde301cca01e"}
Sep 17 01:21:44.813363 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.813327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6w8sw" event={"ID":"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018","Type":"ContainerStarted","Data":"44c68c2d895a9af8b29468f81549a251b7907586cd744514f663272c0e02c48a"}
Sep 17 01:21:44.814714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:44.814693    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"c4ecc5ab01c516a2511937e1e301ebba43418750b4929e704ad8c6c367040463"}
Sep 17 01:21:45.321470 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.321239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:45.321470 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.321444    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:45.321727 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.321532    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:21:47.32150932 +0000 UTC m=+5.965617379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:45.422484 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.422442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:45.422676 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.422526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:45.422743 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422707    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:45.422743 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422731    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:45.422743 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422744    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:45.422931 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422810    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:47.422788402 +0000 UTC m=+6.066896504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:45.422931 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422923    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:45.423042 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.422961    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:47.422949063 +0000 UTC m=+6.067057125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:45.741894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.741813    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 01:16:44 +0000 UTC" deadline="2028-06-10 22:01:08.899846032 +0000 UTC"
Sep 17 01:21:45.741894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.741868    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15188h39m23.157981734s"
Sep 17 01:21:45.793825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.793027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:45.793825 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.793176    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:45.793825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.793648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:45.793825 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.793780    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:45.794409 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:45.794278    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:45.794409 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:45.794375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:46.840927 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:46.839995    2573 generic.go:356] "Generic (PLEG): container finished" podID="31c75b674bb7296b0e2edd44b2672e07" containerID="2437242b05650bd73c15ed8f79cd8bee49c0674828903a154ca40c196389e504" exitCode=0
Sep 17 01:21:46.840927 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:46.840100    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal" event={"ID":"31c75b674bb7296b0e2edd44b2672e07","Type":"ContainerDied","Data":"2437242b05650bd73c15ed8f79cd8bee49c0674828903a154ca40c196389e504"}
Sep 17 01:21:46.853571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:46.853542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal" event={"ID":"27f1f42501049c1b81a90668ada60c8b","Type":"ContainerStarted","Data":"e10bc3bc81d298b85c8ddff86c6312e59f0acf710f572e382fbba5a4b2bb406b"}
Sep 17 01:21:47.342400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.342364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:47.342615 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.342532    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:47.342615 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.342593    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:21:51.342574373 +0000 UTC m=+9.986682435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:47.443132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.443025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:47.443132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.443100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:47.443433 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443287    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:47.443433 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443310    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:47.443433 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443323    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:47.443433 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443386    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:51.443364468 +0000 UTC m=+10.087472530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:47.443651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443431    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:47.443651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.443490    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:51.443472499 +0000 UTC m=+10.087580566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:47.794197 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.794111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:47.794359 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.794257    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:47.794697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.794675    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:47.794860 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.794793    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:47.794944 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.794899    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:47.795007 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:47.794985    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:47.863965 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.863914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal" event={"ID":"31c75b674bb7296b0e2edd44b2672e07","Type":"ContainerStarted","Data":"8c64c630308b6006925970bc8e819426520da833db773beb0959119a551e5fce"}
Sep 17 01:21:47.881743 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.881675    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-54.ec2.internal" podStartSLOduration=3.881654899 podStartE2EDuration="3.881654899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:21:46.872375802 +0000 UTC m=+5.516483888" watchObservedRunningTime="2026-09-17 01:21:47.881654899 +0000 UTC m=+6.525762982"
Sep 17 01:21:47.881990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:47.881940    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-54.ec2.internal" podStartSLOduration=3.8819286 podStartE2EDuration="3.8819286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:21:47.881819854 +0000 UTC m=+6.525927928" watchObservedRunningTime="2026-09-17 01:21:47.8819286 +0000 UTC m=+6.526036683"
Sep 17 01:21:49.793116 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:49.792887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:49.793116 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:49.792887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:49.793116 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:49.793036    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:49.793725 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:49.793186    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:49.793725 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:49.793225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:49.793725 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:49.793295    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:51.377998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.377965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:51.378445 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.378153    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:51.378445 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.378230    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:21:59.378213867 +0000 UTC m=+18.022321927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:51.478962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.478927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:51.479155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.478997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:51.479221 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479154    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:51.479221 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479174    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:51.479221 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479190    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:51.479365 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479250    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:59.479230224 +0000 UTC m=+18.123338305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:51.479365 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479306    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:51.479465 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.479378    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:21:59.479360384 +0000 UTC m=+18.123468450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:51.793703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.793625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:51.793900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.793769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:51.793900 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.793819    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:51.793900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:51.793848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:51.794075 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.793958    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:51.794075 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:51.794038    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:53.796888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:53.796855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:53.796888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:53.796902    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:53.797588 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:53.797007    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:53.797588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:53.797043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:53.797588 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:53.797096    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:53.797588 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:53.797422    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:55.795229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:55.795201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:55.795547 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:55.795294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:55.795547 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:55.795297    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:55.795547 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:55.795306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:55.795933 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:55.795894    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:55.796249 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:55.796192    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:57.796094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:57.796064    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:57.796576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:57.796191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:57.796576 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:57.796307    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:57.796576 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:57.796193    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:21:57.796576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:57.796198    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:57.796576 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:57.796405    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:59.437067 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.437024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:59.437587 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.437190    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:59.437587 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.437267    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:22:15.437245699 +0000 UTC m=+34.081353768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:21:59.538347 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.538312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:59.538510 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.538362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:59.538510 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538469    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:21:59.538510 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538471    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:59.538651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538549    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:15.538530941 +0000 UTC m=+34.182639015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:21:59.538651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538481    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:21:59.538651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538576    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:59.538651 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.538623    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:15.53861074 +0000 UTC m=+34.182718800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:21:59.792643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.792572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:21:59.792643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.792572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:21:59.792890 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.792682    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:21:59.792890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:21:59.792711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:21:59.792890 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.792797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:21:59.793052 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:21:59.792908    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:01.793302 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:01.793271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:01.793710 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:01.793382    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:01.793710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:01.793460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:01.793710 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:01.793575    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:01.793710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:01.793630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:01.793891 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:01.793722    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:03.795791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.795594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:03.796165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.795640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:03.796165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.795640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:03.796165 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:03.795903    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:03.796165 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:03.795940    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:03.796165 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:03.795978    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:03.907552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.907517    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"a412f489aad12c2e2f21608cd93d68f188692283b15df45492ea7ef69c1b5a6b"}
Sep 17 01:22:03.907678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.907586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"aec26371dcb781d21004cc5b3ae9cead1e1adfd9f01135c4407ffadf3345760d"}
Sep 17 01:22:03.907678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.907630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"5bf89bb8a15d513fb78a522d2627b0cacd41b3d432010d5ff1976161a57c1dee"}
Sep 17 01:22:03.909394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.909367    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="8dfd09d056d66a08ec49274306585466ada2d89829128cd3e209afe26a7dc264" exitCode=0
Sep 17 01:22:03.909481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.909451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"8dfd09d056d66a08ec49274306585466ada2d89829128cd3e209afe26a7dc264"}
Sep 17 01:22:03.911700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.911503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sm6vk" event={"ID":"7db90a84-dd5b-404b-bcc1-45a213c48f04","Type":"ContainerStarted","Data":"afe08667f34e09756440436f17a994d479c86e5e1ba0e78142ac7039d323c485"}
Sep 17 01:22:03.913757 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.913710    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tbrn" event={"ID":"21a88fb2-87c8-48c9-ba3f-b9111796aba1","Type":"ContainerStarted","Data":"9fd4c6249645b820cbfa6ba4b3fc763da8a58a08267f47cc41d2b20a8233cd8c"}
Sep 17 01:22:03.915618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.915592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7wvg" event={"ID":"bba43f8d-2032-489d-b1cc-36543b391759","Type":"ContainerStarted","Data":"44c9f492e8b8214cec6e1480db2b84c00b2a559cdf902f65225c849372981540"}
Sep 17 01:22:03.917599 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.917575    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzvgl" event={"ID":"fa1ffdd7-52e2-4029-bdde-f0fa8b0e8856","Type":"ContainerStarted","Data":"bd31f7e30409bdeb9e74f2c6c5a1644a25c1d979903b33163fccb7b488dc159c"}
Sep 17 01:22:03.919146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.919127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p" event={"ID":"52f4d384-3500-46ed-8500-e5bbc5b16bbf","Type":"ContainerStarted","Data":"2fc42634ba06d071c415feed003bb587193e0d53f79ec4b82bcf0510ce4a6333"}
Sep 17 01:22:03.920647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.920624    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6w8sw" event={"ID":"9aaaaeb0-ad83-4a1f-aaa9-e584fc804018","Type":"ContainerStarted","Data":"850b26f55ffb559d31a32c1e57130ae2b61ad083010115528823284f0c870af3"}
Sep 17 01:22:03.944186 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.944147    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qzvgl" podStartSLOduration=1.561576615 podStartE2EDuration="20.944132939s" totalImagesPullingTime="19.382556324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:03.943739038 +0000 UTC m=+22.587847128" watchObservedRunningTime="2026-09-17 01:22:03.944132939 +0000 UTC m=+22.588241017"
Sep 17 01:22:03.982635 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.982592    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5tbrn" podStartSLOduration=10.120677657 podStartE2EDuration="21.982576219s" totalImagesPullingTime="11.861898562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:03.956376808 +0000 UTC m=+22.600484899" watchObservedRunningTime="2026-09-17 01:22:03.982576219 +0000 UTC m=+22.626684315"
Sep 17 01:22:03.983035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.983009    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6w8sw" podStartSLOduration=2.547175391 podStartE2EDuration="21.982999837s" totalImagesPullingTime="19.435824446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:03.982803588 +0000 UTC m=+22.626911688" watchObservedRunningTime="2026-09-17 01:22:03.982999837 +0000 UTC m=+22.627107915"
Sep 17 01:22:03.998932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:03.998871    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sm6vk" podStartSLOduration=1.63159287 podStartE2EDuration="20.998858478s" totalImagesPullingTime="19.367265608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:03.998651177 +0000 UTC m=+22.642759277" watchObservedRunningTime="2026-09-17 01:22:03.998858478 +0000 UTC m=+22.642966557"
Sep 17 01:22:04.012405 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.012372    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h7wvg" podStartSLOduration=1.651900109 podStartE2EDuration="21.012361741s" totalImagesPullingTime="19.360461632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:04.01200966 +0000 UTC m=+22.656117748" watchObservedRunningTime="2026-09-17 01:22:04.012361741 +0000 UTC m=+22.656469819"
Sep 17 01:22:04.852208 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.852184    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 01:22:04.926504 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.926474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"ac2b56f56a7b2efbfe514bb09067244703ff19a6d90e6570f61e2526f39b4e5f"}
Sep 17 01:22:04.926660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.926579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"5545a5f56f4b093937a9a15b51422a80a10867c77348fa7387c6c8c8b3a896b6"}
Sep 17 01:22:04.926660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.926616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"104f6cc21a04e364900f649569a65abd502dc3a5d938a45536183006fd700317"}
Sep 17 01:22:04.928630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.928600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p" event={"ID":"52f4d384-3500-46ed-8500-e5bbc5b16bbf","Type":"ContainerStarted","Data":"993a7215b4b8ff98515e5d32b4af49e43483214dba033c9624c669546b82e03a"}
Sep 17 01:22:04.930336 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.930312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jkm9r" event={"ID":"83bda2bd-f277-4c81-98c7-a1dd8ad7a50c","Type":"ContainerStarted","Data":"7f1ee48616212c3030f4b9be54edc2f30be7a4b82d5cc1f42b447a297d78951a"}
Sep 17 01:22:04.944158 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:04.944112    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jkm9r" podStartSLOduration=3.555584576 podStartE2EDuration="22.944094093s" totalImagesPullingTime="19.388509517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:04.943659717 +0000 UTC m=+23.587767817" watchObservedRunningTime="2026-09-17 01:22:04.944094093 +0000 UTC m=+23.588202176"
Sep 17 01:22:05.759339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.759212    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T01:22:04.852205554Z","UUID":"7511e47a-61c5-41ec-bfff-e6466d7b3eba","Handler":null,"Name":"","Endpoint":""}
Sep 17 01:22:05.761048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.761026    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 01:22:05.761161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.761059    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 01:22:05.796725 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.796695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:05.796906 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:05.796812    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:05.797131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.797071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:05.797131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:05.797092    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:05.797279 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:05.797204    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:05.797334 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:05.797278    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:06.938071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:06.938035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p" event={"ID":"52f4d384-3500-46ed-8500-e5bbc5b16bbf","Type":"ContainerStarted","Data":"c786edd01caf9cc3d2ca791e06214e645d425cb3caeda5ddee2061a3cf11925f"}
Sep 17 01:22:06.947947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:06.947915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"29e1410587863fab3d124867233e35c0170b89c6ff4dfb4c4ece490c4aed2e0e"}
Sep 17 01:22:06.954889 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:06.954834    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khc5p" podStartSLOduration=2.22291602 podStartE2EDuration="23.954814821s" totalImagesPullingTime="21.731898801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:06.953887976 +0000 UTC m=+25.597996054" watchObservedRunningTime="2026-09-17 01:22:06.954814821 +0000 UTC m=+25.598922897"
Sep 17 01:22:07.793134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:07.793095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:07.793318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:07.793095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:07.793318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:07.793235    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:07.793318 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:07.793235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:07.793473 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:07.793364    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:07.793473 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:07.793454    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:08.786631 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:08.786362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:22:08.787324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:08.787306    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:22:08.959400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:08.959376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:22:08.959946 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:08.959927    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5tbrn"
Sep 17 01:22:09.793420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.793352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:09.793420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.793363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:09.793889 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.793498    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:09.793889 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:09.793510    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:09.793889 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:09.793596    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:09.793889 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:09.793663    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:09.957789 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.957750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" event={"ID":"854f5ac5-41e0-4854-947a-b91ee72b2676","Type":"ContainerStarted","Data":"c48693be989c57f99289a0ab7295feae62bb7dd924f54bf66fda66cad5466455"}
Sep 17 01:22:09.958028 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.958005    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:09.959882 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.959860    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="62bed0c0320795417122ae816e08036551b123707e58e0653695b8b7ddd88214" exitCode=0
Sep 17 01:22:09.960006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.959927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"62bed0c0320795417122ae816e08036551b123707e58e0653695b8b7ddd88214"}
Sep 17 01:22:09.973643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.973506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:09.985656 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:09.985618    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk" podStartSLOduration=8.516494982 podStartE2EDuration="27.985606766s" totalImagesPullingTime="19.469111784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:09.985150978 +0000 UTC m=+28.629259077" watchObservedRunningTime="2026-09-17 01:22:09.985606766 +0000 UTC m=+28.629714870"
Sep 17 01:22:10.926576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.926540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sqwh"]
Sep 17 01:22:10.927211 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.926656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:10.927211 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:10.926749    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:10.929009 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.928993    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-knzdd"]
Sep 17 01:22:10.929126 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.929076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:10.929187 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:10.929168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:10.938083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.938061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-85vss"]
Sep 17 01:22:10.938157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.938138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:10.938220 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:10.938206    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:10.965139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.965114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerStarted","Data":"63c358deb3b55bc6d61c1ed209bfb69c7bf2ec0bd1bd54091fa59e3f8a210e5a"}
Sep 17 01:22:10.965709 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.965685    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:10.966073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.966056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:10.982963 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:10.982942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:11.969500 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:11.969470    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="63c358deb3b55bc6d61c1ed209bfb69c7bf2ec0bd1bd54091fa59e3f8a210e5a" exitCode=0
Sep 17 01:22:11.969960 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:11.969559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"63c358deb3b55bc6d61c1ed209bfb69c7bf2ec0bd1bd54091fa59e3f8a210e5a"}
Sep 17 01:22:12.792595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:12.792566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:12.792720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:12.792698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:12.792802 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:12.792705    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:12.792802 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:12.792755    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:12.792914 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:12.792885    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:12.793036 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:12.793012    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:12.974979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:12.974899    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="8c05543a5aed8f599975c6457476397d22c9d3cafc293aa790950d21ff8b3774" exitCode=0
Sep 17 01:22:12.975424 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:12.974979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"8c05543a5aed8f599975c6457476397d22c9d3cafc293aa790950d21ff8b3774"}
Sep 17 01:22:14.793118 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:14.792952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:14.793451 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:14.792952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:14.793451 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:14.793198    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:14.793451 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:14.792952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:14.793451 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:14.793264    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:14.793451 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:14.793339    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:15.454995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:15.454965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:15.455197 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.455121    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:22:15.455197 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.455191    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:22:47.455170744 +0000 UTC m=+66.099278818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:22:15.555765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:15.555735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:15.555797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555872    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555895    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555908    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555916    2573 projected.go:196] Error preparing data for projected volume kube-api-access-vr6r4 for pod openshift-network-diagnostics/network-check-target-knzdd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:22:15.555936 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555926    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret podName:869146e5-a15c-4b31-8e1d-6bbcf7cc21f3 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:47.555912661 +0000 UTC m=+66.200020722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret") pod "global-pull-secret-syncer-2sqwh" (UID: "869146e5-a15c-4b31-8e1d-6bbcf7cc21f3") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:22:15.556130 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:15.555952    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4 podName:6e5ff974-87a6-4d02-bee9-277e488fe467 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:47.555941739 +0000 UTC m=+66.200049795 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr6r4" (UniqueName: "kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4") pod "network-check-target-knzdd" (UID: "6e5ff974-87a6-4d02-bee9-277e488fe467") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:22:16.792633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:16.792563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:16.792633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:16.792591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:16.793055 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:16.792666    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:22:16.793055 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:16.792721    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sqwh" podUID="869146e5-a15c-4b31-8e1d-6bbcf7cc21f3"
Sep 17 01:22:16.793055 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:16.792747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:16.793055 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:16.792819    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-knzdd" podUID="6e5ff974-87a6-4d02-bee9-277e488fe467"
Sep 17 01:22:17.157729 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.157701    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-54.ec2.internal" event="NodeReady"
Sep 17 01:22:17.157906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.157862    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 01:22:17.188647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.188607    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:22:17.208684 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.208651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"]
Sep 17 01:22:17.208877 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.208801    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.211536 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.211517    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 01:22:17.211671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.211513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 01:22:17.211897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.211805    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dn79c\""
Sep 17 01:22:17.211993 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.211962    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 01:22:17.216455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.216417    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 01:22:17.223609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.223588    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-656wz"]
Sep 17 01:22:17.223763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.223734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.226139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.226118    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 01:22:17.226231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.226141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4b2xb\""
Sep 17 01:22:17.226231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.226124    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 01:22:17.239648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.239624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:22:17.239729 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.239659    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k8hs9"]
Sep 17 01:22:17.239818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.239742    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.242090 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.242070    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 01:22:17.242314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.242299    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 01:22:17.242396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.242321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sdvq5\""
Sep 17 01:22:17.254108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.254071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"]
Sep 17 01:22:17.254108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.254097    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-656wz"]
Sep 17 01:22:17.254108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.254114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k8hs9"]
Sep 17 01:22:17.254317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.254213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.256415 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.256396    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 01:22:17.256512 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.256400    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 01:22:17.256512 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.256442    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mtkb2\""
Sep 17 01:22:17.256713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.256696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 01:22:17.369131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c325a389-3781-4221-ac3f-f803aa9416af-config-volume\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.369320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wddc\" (UniqueName: \"kubernetes.io/projected/c325a389-3781-4221-ac3f-f803aa9416af-kube-api-access-8wddc\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.369429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12ab0904-be5b-4ed1-a35b-447585b6bd17-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.369429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369415    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa39d415-f721-48d1-b297-3b445b7ca064-cert\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.369615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c325a389-3781-4221-ac3f-f803aa9416af-tmp-dir\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.369615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bl8f\" (UniqueName: \"kubernetes.io/projected/aa39d415-f721-48d1-b297-3b445b7ca064-kube-api-access-7bl8f\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.369615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.369615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.369879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.369879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.369799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzp6\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.373257 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.373225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:17.466073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.466025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:17.470877 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.470850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wddc\" (UniqueName: \"kubernetes.io/projected/c325a389-3781-4221-ac3f-f803aa9416af-kube-api-access-8wddc\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.471010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.470891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.470916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12ab0904-be5b-4ed1-a35b-447585b6bd17-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.471010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.470947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa39d415-f721-48d1-b297-3b445b7ca064-cert\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.471010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c325a389-3781-4221-ac3f-f803aa9416af-tmp-dir\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bl8f\" (UniqueName: \"kubernetes.io/projected/aa39d415-f721-48d1-b297-3b445b7ca064-kube-api-access-7bl8f\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.471209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzp6\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c325a389-3781-4221-ac3f-f803aa9416af-config-volume\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.471491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.471491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c325a389-3781-4221-ac3f-f803aa9416af-tmp-dir\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.471697 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.471547    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:17.471697 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.471606    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:17.971586946 +0000 UTC m=+36.615695002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:17.471903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.471879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12ab0904-be5b-4ed1-a35b-447585b6bd17-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.472007 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.471988    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:17.472074 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.472063    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:17.972044397 +0000 UTC m=+36.616152462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:17.472230 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.472210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.472318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.472230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.472371 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.472322    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:17.472371 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.472337    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:17.472485 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.472397    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:17.972382417 +0000 UTC m=+36.616490476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:17.472568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.472546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c325a389-3781-4221-ac3f-f803aa9416af-config-volume\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.472648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.472622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.476039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.475982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.476039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.475987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.476176 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.476095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa39d415-f721-48d1-b297-3b445b7ca064-cert\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.480561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.480508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzp6\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.480970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.480943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wddc\" (UniqueName: \"kubernetes.io/projected/c325a389-3781-4221-ac3f-f803aa9416af-kube-api-access-8wddc\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.481297 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.481276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bl8f\" (UniqueName: \"kubernetes.io/projected/aa39d415-f721-48d1-b297-3b445b7ca064-kube-api-access-7bl8f\") pod \"ingress-canary-k8hs9\" (UID: \"aa39d415-f721-48d1-b297-3b445b7ca064\") " pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.481381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.481339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.564241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.564212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k8hs9"
Sep 17 01:22:17.836975 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.836880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:17.885763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.885731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:17.976462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.976436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:17.976644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.976532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:17.976644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:17.976568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:17.976644 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976606    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:17.976644 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976628    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:17.976848 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976678    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:17.976848 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976681    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:17.976848 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976691    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:18.976670976 +0000 UTC m=+37.620779051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:17.976848 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976726    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:18.976715533 +0000 UTC m=+37.620823596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:17.976848 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:17.976743    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:18.97673478 +0000 UTC m=+37.620842839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:18.238086 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.238054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:18.295394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.295359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:18.712870 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.712841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k8hs9"]
Sep 17 01:22:18.717211 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:18.717167    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa39d415_f721_48d1_b297_3b445b7ca064.slice/crio-5f6b40a0c3a20ef8ca869ab6b255f64390bed05f944b1e19cf9d8225a5d77e58 WatchSource:0}: Error finding container 5f6b40a0c3a20ef8ca869ab6b255f64390bed05f944b1e19cf9d8225a5d77e58: Status 404 returned error can't find the container with id 5f6b40a0c3a20ef8ca869ab6b255f64390bed05f944b1e19cf9d8225a5d77e58
Sep 17 01:22:18.792826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.792800    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:18.792826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.792817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:18.792938 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.792899    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:18.795400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.795382    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 01:22:18.796534 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.796517    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 01:22:18.796614 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.796550    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6hcd\""
Sep 17 01:22:18.796614 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.796556    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wvztc\""
Sep 17 01:22:18.796614 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.796519    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 01:22:18.796754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.796725    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 01:22:18.985821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.985601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.985854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.985751    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.985900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.985957    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:20.985937764 +0000 UTC m=+39.630045850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.985992    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.986053    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:20.986039204 +0000 UTC m=+39.630147261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.986076    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.986094    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:18.986154 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:18.986153    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:20.986134287 +0000 UTC m=+39.630242362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:18.993048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.993023    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="e19e3e8d484d74eb9120b8e29d7db57e98330d5a997849122b9c3829fb018fad" exitCode=0
Sep 17 01:22:18.993138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.993099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"e19e3e8d484d74eb9120b8e29d7db57e98330d5a997849122b9c3829fb018fad"}
Sep 17 01:22:18.994391 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:18.994368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k8hs9" event={"ID":"aa39d415-f721-48d1-b297-3b445b7ca064","Type":"ContainerStarted","Data":"5f6b40a0c3a20ef8ca869ab6b255f64390bed05f944b1e19cf9d8225a5d77e58"}
Sep 17 01:22:20.001727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:20.001671    2573 generic.go:356] "Generic (PLEG): container finished" podID="4509e74e-a96f-45ec-a4dc-89223bed1c78" containerID="6ee9d42977ed825f4af3248826c62cc169a560344308278ba72ddfe52b44dd51" exitCode=0
Sep 17 01:22:20.002233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:20.001748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerDied","Data":"6ee9d42977ed825f4af3248826c62cc169a560344308278ba72ddfe52b44dd51"}
Sep 17 01:22:21.002513 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.002478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.002533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.002582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002642    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002702    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:25.0026843 +0000 UTC m=+43.646792380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002706    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002731    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002744    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002794    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:25.002761345 +0000 UTC m=+43.646869404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:21.003159 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:21.002813    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:25.002804285 +0000 UTC m=+43.646912342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:21.008722 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.008661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" event={"ID":"4509e74e-a96f-45ec-a4dc-89223bed1c78","Type":"ContainerStarted","Data":"6de0abb8000179a77c3567f38c3db5763eca3dd2f4e0249f86acf9e5331d958b"}
Sep 17 01:22:21.029787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.029730    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s2zw4" podStartSLOduration=6.172398994 podStartE2EDuration="38.029710446s" totalImagesPullingTime="31.857311452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:21.028535062 +0000 UTC m=+39.672643174" watchObservedRunningTime="2026-09-17 01:22:21.029710446 +0000 UTC m=+39.673818528"
Sep 17 01:22:21.164449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.164391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:21.213974 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.213941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:21.770525 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.770490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:21.821247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:21.821214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:22.012894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:22.012806    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k8hs9" event={"ID":"aa39d415-f721-48d1-b297-3b445b7ca064","Type":"ContainerStarted","Data":"fe0bea32b48256d14612410c32574b1e4ecd049b7d7f7a1f4469874951f9fe49"}
Sep 17 01:22:22.027114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:22.027073    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k8hs9" podStartSLOduration=2.082233698 podStartE2EDuration="5.027060141s" totalImagesPullingTime="2.944826443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:22.0267948 +0000 UTC m=+40.670902891" watchObservedRunningTime="2026-09-17 01:22:22.027060141 +0000 UTC m=+40.671168221"
Sep 17 01:22:24.226952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.226902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:24.328077 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.328045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:24.669359 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.669333    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"]
Sep 17 01:22:24.703125 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.703098    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"]
Sep 17 01:22:24.703256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.703218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.707441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.707214    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 01:22:24.707441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.707247    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 01:22:24.707441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.707217    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-k4r5l\""
Sep 17 01:22:24.707685 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.707575    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 01:22:24.707685 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.707638    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 17 01:22:24.717070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.717052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"]
Sep 17 01:22:24.717154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.717076    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"]
Sep 17 01:22:24.717154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.717093    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"]
Sep 17 01:22:24.717227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.717186    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.719864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.719844    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 01:22:24.739123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.739102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"]
Sep 17 01:22:24.739215 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.739186    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.741700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.741681    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 01:22:24.741834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.741685    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 01:22:24.741834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.741685    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 01:22:24.741834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.741685    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 01:22:24.830414 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mn7\" (UniqueName: \"kubernetes.io/projected/88471754-d063-4011-a8fd-80e78e35f80d-kube-api-access-87mn7\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.830549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkltq\" (UniqueName: \"kubernetes.io/projected/2c52d9a3-6999-4250-ae73-b2dea880eef5-kube-api-access-qkltq\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88471754-d063-4011-a8fd-80e78e35f80d-tmp\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.830703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.830703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c52d9a3-6999-4250-ae73-b2dea880eef5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpnx\" (UniqueName: \"kubernetes.io/projected/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-kube-api-access-hnpnx\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.830854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.830854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.830729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/88471754-d063-4011-a8fd-80e78e35f80d-klusterlet-config\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.931936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.931882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.931936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.931909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkltq\" (UniqueName: \"kubernetes.io/projected/2c52d9a3-6999-4250-ae73-b2dea880eef5-kube-api-access-qkltq\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.931936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.931928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88471754-d063-4011-a8fd-80e78e35f80d-tmp\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.932148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.932148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c52d9a3-6999-4250-ae73-b2dea880eef5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.932233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpnx\" (UniqueName: \"kubernetes.io/projected/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-kube-api-access-hnpnx\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.932233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.932233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/88471754-d063-4011-a8fd-80e78e35f80d-klusterlet-config\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.932367 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88471754-d063-4011-a8fd-80e78e35f80d-tmp\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.932367 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.932462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.932462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mn7\" (UniqueName: \"kubernetes.io/projected/88471754-d063-4011-a8fd-80e78e35f80d-kube-api-access-87mn7\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.932988 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.932964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c52d9a3-6999-4250-ae73-b2dea880eef5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.935689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.935664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-ca\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.936205 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.936186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.936282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.936203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.936282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.936224    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-hub\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.936282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.936264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c52d9a3-6999-4250-ae73-b2dea880eef5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.936376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.936298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/88471754-d063-4011-a8fd-80e78e35f80d-klusterlet-config\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:24.939282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.939260    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpnx\" (UniqueName: \"kubernetes.io/projected/6a6100e1-c44d-4fd1-91ba-48bf3daa239f-kube-api-access-hnpnx\") pod \"managed-serviceaccount-addon-agent-64c774bd44-xlj5x\" (UID: \"6a6100e1-c44d-4fd1-91ba-48bf3daa239f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:24.939374 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.939358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkltq\" (UniqueName: \"kubernetes.io/projected/2c52d9a3-6999-4250-ae73-b2dea880eef5-kube-api-access-qkltq\") pod \"cluster-proxy-proxy-agent-76cb697b5b-r7cqq\" (UID: \"2c52d9a3-6999-4250-ae73-b2dea880eef5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:24.939585 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:24.939565    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mn7\" (UniqueName: \"kubernetes.io/projected/88471754-d063-4011-a8fd-80e78e35f80d-kube-api-access-87mn7\") pod \"klusterlet-addon-workmgr-644f79fdfb-tvt5m\" (UID: \"88471754-d063-4011-a8fd-80e78e35f80d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:25.025551 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.025524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:22:25.031679 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.031658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:25.032879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.032864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:25.032928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.032895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:25.032959 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.032926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:25.032999 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.032984    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:25.033029 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033009    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:25.033061 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033028    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:33.033015401 +0000 UTC m=+51.677123459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:25.033061 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033059    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:33.033048167 +0000 UTC m=+51.677156224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:25.033135 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033072    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:25.033135 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033090    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:25.033194 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:25.033140    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:33.033127143 +0000 UTC m=+51.677235200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:25.046854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.046837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:22:25.239500 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.239431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:25.324132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.324103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"]
Sep 17 01:22:25.327178 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:25.327136    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a6100e1_c44d_4fd1_91ba_48bf3daa239f.slice/crio-c3d3bdf1275ae06c485f9928b34e4c9e2c7211fbaec812c9e16ff01ce3bba0d2 WatchSource:0}: Error finding container c3d3bdf1275ae06c485f9928b34e4c9e2c7211fbaec812c9e16ff01ce3bba0d2: Status 404 returned error can't find the container with id c3d3bdf1275ae06c485f9928b34e4c9e2c7211fbaec812c9e16ff01ce3bba0d2
Sep 17 01:22:25.327301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.327237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:25.355189 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.355167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"]
Sep 17 01:22:25.368399 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:25.368376    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88471754_d063_4011_a8fd_80e78e35f80d.slice/crio-547308ece0c1a9ccfa14d36061568a31d738eb547aae7cae61a6c20a523de285 WatchSource:0}: Error finding container 547308ece0c1a9ccfa14d36061568a31d738eb547aae7cae61a6c20a523de285: Status 404 returned error can't find the container with id 547308ece0c1a9ccfa14d36061568a31d738eb547aae7cae61a6c20a523de285
Sep 17 01:22:25.376485 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:25.376465    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"]
Sep 17 01:22:25.378784 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:25.378751    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c52d9a3_6999_4250_ae73_b2dea880eef5.slice/crio-dde8126192fbaee36e001eee41736e550615688b23047d43537d6972489697f2 WatchSource:0}: Error finding container dde8126192fbaee36e001eee41736e550615688b23047d43537d6972489697f2: Status 404 returned error can't find the container with id dde8126192fbaee36e001eee41736e550615688b23047d43537d6972489697f2
Sep 17 01:22:26.023521 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:26.023483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerStarted","Data":"c3d3bdf1275ae06c485f9928b34e4c9e2c7211fbaec812c9e16ff01ce3bba0d2"}
Sep 17 01:22:26.024681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:26.024653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerStarted","Data":"547308ece0c1a9ccfa14d36061568a31d738eb547aae7cae61a6c20a523de285"}
Sep 17 01:22:26.025708 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:26.025688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerStarted","Data":"dde8126192fbaee36e001eee41736e550615688b23047d43537d6972489697f2"}
Sep 17 01:22:29.189256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:29.189186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:30.283798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:30.283668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:30.335761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:30.335711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:33.046989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.046964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerStarted","Data":"06de38212554a6b235ba8f0cc424788cc0bc12ee122a2d3fe1bb7e6664faa828"}
Sep 17 01:22:33.047312 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.047003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerStarted","Data":"5f2bc0b6126d786f8d332ea4f5e2bc06d8b221ec03be0df3cd0be07cb516c999"}
Sep 17 01:22:33.048324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.048292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerStarted","Data":"5100d81dc595b73cfe65a9c93ec207bc549432959fbc3fcda425aef334435c16"}
Sep 17 01:22:33.049761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.049741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerStarted","Data":"0f995f536c240530ae95164ea777c0ff353cb44575a03cc60823a6749ed40a03"}
Sep 17 01:22:33.049932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.049916    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:33.051466 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.051449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:22:33.077707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.077551    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" podStartSLOduration=1.901979627 podStartE2EDuration="9.077533381s" totalImagesPullingTime="7.175553754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:33.061764206 +0000 UTC m=+51.705872284" watchObservedRunningTime="2026-09-17 01:22:33.077533381 +0000 UTC m=+51.721641460"
Sep 17 01:22:33.077976 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.077932    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" podStartSLOduration=1.9504976379999999 podStartE2EDuration="9.077916545s" totalImagesPullingTime="7.127418907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:33.07696668 +0000 UTC m=+51.721074783" watchObservedRunningTime="2026-09-17 01:22:33.077916545 +0000 UTC m=+51.722024629"
Sep 17 01:22:33.101874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.101850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:33.102001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.101984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:33.102059 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:33.102029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:33.102116 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.101986    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:33.102116 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102083    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:33.102215 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102132    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:33.102215 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102149    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:33.102215 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102162    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:49.102142155 +0000 UTC m=+67.746250219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:33.102215 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102207    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:22:49.10218496 +0000 UTC m=+67.746293037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:33.102423 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:33.102228    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:22:49.102218113 +0000 UTC m=+67.746326175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:34.055286 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:34.055246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerStarted","Data":"e62510634fd5eb44c826a734a021569e5052ec4924a5b602856e7149f937fa17"}
Sep 17 01:22:34.071412 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:34.071259    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" podStartSLOduration=2.667165346 podStartE2EDuration="10.071242558s" totalImagesPullingTime="7.404077212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:34.071172443 +0000 UTC m=+52.715280522" watchObservedRunningTime="2026-09-17 01:22:34.071242558 +0000 UTC m=+52.715350640"
Sep 17 01:22:35.748077 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:35.748040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:37.579997 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:37.579961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:37.636296 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:37.636266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:38.522462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:38.522422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:38.569953 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:38.569913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:40.494479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:40.494442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:40.551091 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:40.551057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:41.874417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:41.874383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:42.985659 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:42.985634    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vmvk"
Sep 17 01:22:43.128666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:43.128623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:43.183260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:43.183230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:43.329487 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:43.329402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:43.429381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:43.429353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:47.513931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.513892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:22:47.518765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.518747    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 01:22:47.524902 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:47.524886    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:22:47.524959 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:47.524941    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:23:51.524925486 +0000 UTC m=+130.169033543 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : secret "metrics-daemon-secret" not found
Sep 17 01:22:47.614386 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.614351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:47.614516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.614398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:47.616989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.616973    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 01:22:47.617041 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.617009    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 01:22:47.626970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.626951    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 01:22:47.627123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.627106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/869146e5-a15c-4b31-8e1d-6bbcf7cc21f3-original-pull-secret\") pod \"global-pull-secret-syncer-2sqwh\" (UID: \"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3\") " pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:47.637888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.637868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr6r4\" (UniqueName: \"kubernetes.io/projected/6e5ff974-87a6-4d02-bee9-277e488fe467-kube-api-access-vr6r4\") pod \"network-check-target-knzdd\" (UID: \"6e5ff974-87a6-4d02-bee9-277e488fe467\") " pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:47.645902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.645883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wvztc\""
Sep 17 01:22:47.654796 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.654780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:47.910944 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.910917    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sqwh"
Sep 17 01:22:47.920753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:47.920726    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-knzdd"]
Sep 17 01:22:47.923961 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:47.923939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5ff974_87a6_4d02_bee9_277e488fe467.slice/crio-978d8ad5bef6e1aad486a314e814fa0197dea94c3f474e7e872220e83f14c94c WatchSource:0}: Error finding container 978d8ad5bef6e1aad486a314e814fa0197dea94c3f474e7e872220e83f14c94c: Status 404 returned error can't find the container with id 978d8ad5bef6e1aad486a314e814fa0197dea94c3f474e7e872220e83f14c94c
Sep 17 01:22:48.096135 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:48.096092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-knzdd" event={"ID":"6e5ff974-87a6-4d02-bee9-277e488fe467","Type":"ContainerStarted","Data":"978d8ad5bef6e1aad486a314e814fa0197dea94c3f474e7e872220e83f14c94c"}
Sep 17 01:22:48.182045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:48.181974    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sqwh"]
Sep 17 01:22:48.185057 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:22:48.185032    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869146e5_a15c_4b31_8e1d_6bbcf7cc21f3.slice/crio-8d914fc91841dc1b67941a7fde4a6dc85f4e5d1ebbaea8eea0b80a33d4c2049f WatchSource:0}: Error finding container 8d914fc91841dc1b67941a7fde4a6dc85f4e5d1ebbaea8eea0b80a33d4c2049f: Status 404 returned error can't find the container with id 8d914fc91841dc1b67941a7fde4a6dc85f4e5d1ebbaea8eea0b80a33d4c2049f
Sep 17 01:22:49.101667 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.101627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sqwh" event={"ID":"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3","Type":"ContainerStarted","Data":"8d914fc91841dc1b67941a7fde4a6dc85f4e5d1ebbaea8eea0b80a33d4c2049f"}
Sep 17 01:22:49.124760 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.124727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:22:49.124924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.124795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:22:49.124924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.124851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:22:49.124924 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.124890    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.124958    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:23:21.124936313 +0000 UTC m=+99.769044391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.124963    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.124974    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.124959    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.125019    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:23:21.125006628 +0000 UTC m=+99.769114698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:22:49.125081 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:22:49.125057    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:23:21.12504237 +0000 UTC m=+99.769150427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:22:49.273056 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.273014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:49.328269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:49.328176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:53.120088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:53.120060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-knzdd" event={"ID":"6e5ff974-87a6-4d02-bee9-277e488fe467","Type":"ContainerStarted","Data":"f19563eb2be9186e8ebfd1ed8cca657f533acd64ad085b7494574ec5d6fc7174"}
Sep 17 01:22:54.124601 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:54.124558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sqwh" event={"ID":"869146e5-a15c-4b31-8e1d-6bbcf7cc21f3","Type":"ContainerStarted","Data":"83354bbc68b646ea91099720d37903fc760e41a76b357833ff795dfbf8aa120d"}
Sep 17 01:22:54.150951 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:54.150802    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2sqwh" podStartSLOduration=66.323679601 podStartE2EDuration="1m11.150788892s" totalImagesPullingTime="4.827109291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:54.13802152 +0000 UTC m=+72.782129621" watchObservedRunningTime="2026-09-17 01:22:54.150788892 +0000 UTC m=+72.794896962"
Sep 17 01:22:54.151467 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:54.151438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-knzdd" podStartSLOduration=67.075410046 podStartE2EDuration="1m12.151430673s" totalImagesPullingTime="5.076020627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:22:54.150561767 +0000 UTC m=+72.794669867" watchObservedRunningTime="2026-09-17 01:22:54.151430673 +0000 UTC m=+72.795538774"
Sep 17 01:22:54.772506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:54.772472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:54.828411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:54.828378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:55.127836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:55.127805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:22:56.601737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:56.601702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:22:56.701012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:22:56.700975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:01.303588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:01.303556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:01.403553 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:01.403515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:16.540701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:16.540575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:16.641634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:16.641599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:21.157974 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:21.157937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:21.157999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:21.158025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158092    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158112    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158121    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158134    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158169    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:24:25.158151801 +0000 UTC m=+163.802259858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158182    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:24:25.158176718 +0000 UTC m=+163.802284775 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:23:21.158339 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:21.158193    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:24:25.158188169 +0000 UTC m=+163.802296226 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:23:26.132670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:26.132631    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-knzdd"
Sep 17 01:23:44.912536 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:44.912492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:23:51.579137 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:23:51.579093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:23:51.579624 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:51.579212    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:23:51.579624 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:23:51.579274    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:25:53.5792606 +0000 UTC m=+252.223368657 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : secret "metrics-daemon-secret" not found
Sep 17 01:24:20.221540 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:20.221500    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-777766695f-9t4fs" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396"
Sep 17 01:24:20.233663 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:20.233640    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6" podUID="12ab0904-be5b-4ed1-a35b-447585b6bd17"
Sep 17 01:24:20.248816 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:20.248769    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-656wz" podUID="c325a389-3781-4221-ac3f-f803aa9416af"
Sep 17 01:24:20.363058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:20.363036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:24:20.363179 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:20.363036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:24:20.363220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:20.363036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656wz"
Sep 17 01:24:21.839451 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:21.839416    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:24:25.219314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:25.219277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:25.219323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:25.219367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219426    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219483    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219491    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls podName:c325a389-3781-4221-ac3f-f803aa9416af nodeName:}" failed. No retries permitted until 2026-09-17 01:26:27.219472007 +0000 UTC m=+285.863580084 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls") pod "dns-default-656wz" (UID: "c325a389-3781-4221-ac3f-f803aa9416af") : secret "dns-default-metrics-tls" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219493    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219569    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert podName:12ab0904-be5b-4ed1-a35b-447585b6bd17 nodeName:}" failed. No retries permitted until 2026-09-17 01:26:27.219555004 +0000 UTC m=+285.863663067 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8l7t6" (UID: "12ab0904-be5b-4ed1-a35b-447585b6bd17") : secret "networking-console-plugin-cert" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219494    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777766695f-9t4fs: secret "image-registry-tls" not found
Sep 17 01:24:25.219677 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:24:25.219603    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls podName:2258b4ab-625a-4636-8c3b-6cc11fd83396 nodeName:}" failed. No retries permitted until 2026-09-17 01:26:27.219596274 +0000 UTC m=+285.863704331 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls") pod "image-registry-777766695f-9t4fs" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396") : secret "image-registry-tls" not found
Sep 17 01:24:33.051079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.050988    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" podUID="88471754-d063-4011-a8fd-80e78e35f80d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused"
Sep 17 01:24:33.398561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.398529    2573 generic.go:356] "Generic (PLEG): container finished" podID="6a6100e1-c44d-4fd1-91ba-48bf3daa239f" containerID="5100d81dc595b73cfe65a9c93ec207bc549432959fbc3fcda425aef334435c16" exitCode=255
Sep 17 01:24:33.398731 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.398601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerDied","Data":"5100d81dc595b73cfe65a9c93ec207bc549432959fbc3fcda425aef334435c16"}
Sep 17 01:24:33.398962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.398937    2573 scope.go:117] "RemoveContainer" containerID="5100d81dc595b73cfe65a9c93ec207bc549432959fbc3fcda425aef334435c16"
Sep 17 01:24:33.400271 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.400204    2573 generic.go:356] "Generic (PLEG): container finished" podID="88471754-d063-4011-a8fd-80e78e35f80d" containerID="0f995f536c240530ae95164ea777c0ff353cb44575a03cc60823a6749ed40a03" exitCode=1
Sep 17 01:24:33.400271 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.400248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerDied","Data":"0f995f536c240530ae95164ea777c0ff353cb44575a03cc60823a6749ed40a03"}
Sep 17 01:24:33.400514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:33.400500    2573 scope.go:117] "RemoveContainer" containerID="0f995f536c240530ae95164ea777c0ff353cb44575a03cc60823a6749ed40a03"
Sep 17 01:24:34.404989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:34.404893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerStarted","Data":"a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678"}
Sep 17 01:24:34.406517 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:34.406496    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerStarted","Data":"1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"}
Sep 17 01:24:34.406732 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:34.406717    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:24:34.407381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:34.407367    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:24:35.793393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:24:35.793354    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:25:53.647043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:25:53.647009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:25:53.647667 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:25:53.647156    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:25:53.647667 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:25:53.647224    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs podName:8c3c5fcf-0d87-459b-8ae4-c687356b9bdc nodeName:}" failed. No retries permitted until 2026-09-17 01:27:55.64720752 +0000 UTC m=+374.291315577 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs") pod "network-metrics-daemon-85vss" (UID: "8c3c5fcf-0d87-459b-8ae4-c687356b9bdc") : secret "metrics-daemon-secret" not found
Sep 17 01:26:05.024289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:05.024201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:05.075856 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:05.075832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:08.671998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.671962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:08.774158 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.774129    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ns6ht"]
Sep 17 01:26:08.775145 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.775121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:08.777087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.777073    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.780842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.780816    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 01:26:08.781331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.781315    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 01:26:08.782244 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.782226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkzkb\""
Sep 17 01:26:08.782491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.782476    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 01:26:08.782588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.782538    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 01:26:08.792854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.792835    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ns6ht"]
Sep 17 01:26:08.840427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.840404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:08.844467 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.844446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68988d36-dad1-4abd-bfa7-695b1fa0cadc-crio-socket\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.844600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.844472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnlp2\" (UniqueName: \"kubernetes.io/projected/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-api-access-mnlp2\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.844600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.844494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.844600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.844535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68988d36-dad1-4abd-bfa7-695b1fa0cadc-data-volume\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.844738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.844710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68988d36-dad1-4abd-bfa7-695b1fa0cadc-crio-socket\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnlp2\" (UniqueName: \"kubernetes.io/projected/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-api-access-mnlp2\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945740 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68988d36-dad1-4abd-bfa7-695b1fa0cadc-crio-socket\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945740 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68988d36-dad1-4abd-bfa7-695b1fa0cadc-data-volume\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945740 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.945740 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:08.945681    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:08.945915 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:08.945744    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:09.445728296 +0000 UTC m=+268.089836353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:08.945915 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:08.945744    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:26:08.945915 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:08.945828    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:09.445814731 +0000 UTC m=+268.089922791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : configmap "kube-rbac-proxy" not found
Sep 17 01:26:08.946030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.945938    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68988d36-dad1-4abd-bfa7-695b1fa0cadc-data-volume\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:08.957247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:08.957221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnlp2\" (UniqueName: \"kubernetes.io/projected/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-api-access-mnlp2\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:09.049629 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.049596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:09.150201 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.150119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:09.391181 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.391153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:09.446111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.446083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:09.449177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.449158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:09.449231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:09.449208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:09.449295 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:09.449282    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:26:09.449295 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:09.449289    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:09.449372 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:09.449335    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:10.449322656 +0000 UTC m=+269.093430713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : configmap "kube-rbac-proxy" not found
Sep 17 01:26:09.449424 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:09.449369    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:10.449345817 +0000 UTC m=+269.093453896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:10.187590 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.187557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:10.278885 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.278856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:10.378658 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.378631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:10.456383 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.456312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:10.456502 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.456388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:10.456502 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:10.456424    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:26:10.456502 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:10.456478    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:10.456598 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:10.456482    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:12.456465445 +0000 UTC m=+271.100573502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : configmap "kube-rbac-proxy" not found
Sep 17 01:26:10.456598 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:10.456532    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:12.45652074 +0000 UTC m=+271.100628797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:10.550079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:10.550057    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7wvg_bba43f8d-2032-489d-b1cc-36543b391759/dns-node-resolver/0.log"
Sep 17 01:26:11.007038 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:11.007009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:11.059653 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:11.059622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:11.841352 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:11.841311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:11.948245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:11.948221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sm6vk_7db90a84-dd5b-404b-bcc1-45a213c48f04/node-ca/0.log"
Sep 17 01:26:12.470436 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.470402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:12.470594 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.470452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:12.470594 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:12.470547    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:26:12.470594 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:12.470550    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:12.470687 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:12.470605    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:16.47059257 +0000 UTC m=+275.114700627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : configmap "kube-rbac-proxy" not found
Sep 17 01:26:12.470687 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:12.470618    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:16.470612563 +0000 UTC m=+275.114720619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:12.548980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.548957    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k8hs9_aa39d415-f721-48d1-b297-3b445b7ca064/serve-healthcheck-canary/0.log"
Sep 17 01:26:12.699592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.699563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:12.876319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.876292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:12.970592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:12.970570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:13.037059 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:13.037030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:13.209454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:13.209383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:13.401784 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:13.401756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:13.954057 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:13.954027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:14.623410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:14.623378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:14.804163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:14.804134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:15.013483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:15.013391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:15.207617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:15.207569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:15.408626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:15.408596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:15.610169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:15.610131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:15.949679 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:15.949647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:16.406703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:16.406675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:16.496493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:16.496462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:16.496643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:16.496516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:16.496643 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:16.496602    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:16.496643 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:16.496631    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:26:16.496804 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:16.496661    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:24.496646452 +0000 UTC m=+283.140754513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:26:16.496804 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:16.496695    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm podName:68988d36-dad1-4abd-bfa7-695b1fa0cadc nodeName:}" failed. No retries permitted until 2026-09-17 01:26:24.49667733 +0000 UTC m=+283.140785406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns6ht" (UID: "68988d36-dad1-4abd-bfa7-695b1fa0cadc") : configmap "kube-rbac-proxy" not found
Sep 17 01:26:16.606268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:16.606239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:16.706662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:16.706592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:17.001029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:17.000943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:17.202241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:17.202183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:17.802272 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:17.802244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:18.319880 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:18.319845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:18.419336 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:18.419304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:18.621435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:18.621407    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:19.004377 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:19.004297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:19.195421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:19.195393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:19.243932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:19.243908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:19.802474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:19.802444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:20.204716 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:20.204684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:20.403171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:20.403143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:21.013824 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:21.013794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:21.406029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:21.406001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:21.602470 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:21.602428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:21.985427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:21.985383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:22.040182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:22.040145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:22.401113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:22.401072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:22.802787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:22.802675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:23.203026 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.202993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:23.363997 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:23.363961    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-777766695f-9t4fs" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396"
Sep 17 01:26:23.364145 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:23.363961    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-656wz" podUID="c325a389-3781-4221-ac3f-f803aa9416af"
Sep 17 01:26:23.364145 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:23.363961    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6" podUID="12ab0904-be5b-4ed1-a35b-447585b6bd17"
Sep 17 01:26:23.399279 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.399232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:23.716785 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.716751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:23.716956 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.716752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:26:23.716956 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.716756    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:23.760242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.760212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:23.813318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.813293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:23.914079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:23.914057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:24.562650 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.562616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:24.562866 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.562699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:24.563216 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.563190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68988d36-dad1-4abd-bfa7-695b1fa0cadc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:24.564978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.564958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68988d36-dad1-4abd-bfa7-695b1fa0cadc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns6ht\" (UID: \"68988d36-dad1-4abd-bfa7-695b1fa0cadc\") " pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:24.573246 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.573222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:24.686589 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.686565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ns6ht"
Sep 17 01:26:24.953448 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:24.953318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ns6ht"]
Sep 17 01:26:24.956075 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:26:24.956042    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68988d36_dad1_4abd_bfa7_695b1fa0cadc.slice/crio-a6eecea9ab1a87c948f9ef50a2a5c5fa561a49f767eaa0bec4c2d6b5323b4365 WatchSource:0}: Error finding container a6eecea9ab1a87c948f9ef50a2a5c5fa561a49f767eaa0bec4c2d6b5323b4365: Status 404 returned error can't find the container with id a6eecea9ab1a87c948f9ef50a2a5c5fa561a49f767eaa0bec4c2d6b5323b4365
Sep 17 01:26:25.724013 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:25.723980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns6ht" event={"ID":"68988d36-dad1-4abd-bfa7-695b1fa0cadc","Type":"ContainerStarted","Data":"d24a823bbda6f3024569592b024ce73b8da9ad151e9b90ce274a084145875b86"}
Sep 17 01:26:25.724182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:25.724043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns6ht" event={"ID":"68988d36-dad1-4abd-bfa7-695b1fa0cadc","Type":"ContainerStarted","Data":"a6eecea9ab1a87c948f9ef50a2a5c5fa561a49f767eaa0bec4c2d6b5323b4365"}
Sep 17 01:26:26.728950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:26.728907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns6ht" event={"ID":"68988d36-dad1-4abd-bfa7-695b1fa0cadc","Type":"ContainerStarted","Data":"c5914dd4152fb0c4ae78812b8ebd436a77061c5e707243b3a7d376864d96cdda"}
Sep 17 01:26:26.951361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:26.951327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:27.050443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.050363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:27.248301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.248271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:27.283620 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.283593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:27.283702 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.283641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:27.283748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.283732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:26:27.285885 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.285862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c325a389-3781-4221-ac3f-f803aa9416af-metrics-tls\") pod \"dns-default-656wz\" (UID: \"c325a389-3781-4221-ac3f-f803aa9416af\") " pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:27.285968 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.285888    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"image-registry-777766695f-9t4fs\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") " pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:27.286130 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.286108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12ab0904-be5b-4ed1-a35b-447585b6bd17-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8l7t6\" (UID: \"12ab0904-be5b-4ed1-a35b-447585b6bd17\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:26:27.320313 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.320251    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4b2xb\""
Sep 17 01:26:27.320413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.320355    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dn79c\""
Sep 17 01:26:27.320507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.320484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sdvq5\""
Sep 17 01:26:27.328232 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.328210    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:27.328291 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.328241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:27.328291 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.328263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"
Sep 17 01:26:27.604071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.604044    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-656wz"]
Sep 17 01:26:27.606661 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:26:27.606628    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc325a389_3781_4221_ac3f_f803aa9416af.slice/crio-d557e8fad80ad7e925f044942a8b10e6ad159bd5db21f4c3452cd913c59cbd10 WatchSource:0}: Error finding container d557e8fad80ad7e925f044942a8b10e6ad159bd5db21f4c3452cd913c59cbd10: Status 404 returned error can't find the container with id d557e8fad80ad7e925f044942a8b10e6ad159bd5db21f4c3452cd913c59cbd10
Sep 17 01:26:27.611799 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.611767    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:26:27.614173 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:26:27.614131    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2258b4ab_625a_4636_8c3b_6cc11fd83396.slice/crio-f95a4a76553112814cca2ed8b20df08fec18885a386e7b80047f63a9d946e379 WatchSource:0}: Error finding container f95a4a76553112814cca2ed8b20df08fec18885a386e7b80047f63a9d946e379: Status 404 returned error can't find the container with id f95a4a76553112814cca2ed8b20df08fec18885a386e7b80047f63a9d946e379
Sep 17 01:26:27.614323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.614306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6"]
Sep 17 01:26:27.617885 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:26:27.617865    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ab0904_be5b_4ed1_a35b_447585b6bd17.slice/crio-36a4a219449b67485d7c819d6f88c75e162d6407e8da08b1f1741dc2e2480107 WatchSource:0}: Error finding container 36a4a219449b67485d7c819d6f88c75e162d6407e8da08b1f1741dc2e2480107: Status 404 returned error can't find the container with id 36a4a219449b67485d7c819d6f88c75e162d6407e8da08b1f1741dc2e2480107
Sep 17 01:26:27.629780 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.629746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:27.730701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.730668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:27.734981 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.734957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns6ht" event={"ID":"68988d36-dad1-4abd-bfa7-695b1fa0cadc","Type":"ContainerStarted","Data":"c3a3627e9cfafca9321015dcab4139c2c1b4212021bcc1799e17fa3ecb593ca3"}
Sep 17 01:26:27.736134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.736111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656wz" event={"ID":"c325a389-3781-4221-ac3f-f803aa9416af","Type":"ContainerStarted","Data":"d557e8fad80ad7e925f044942a8b10e6ad159bd5db21f4c3452cd913c59cbd10"}
Sep 17 01:26:27.737304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.737284    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6" event={"ID":"12ab0904-be5b-4ed1-a35b-447585b6bd17","Type":"ContainerStarted","Data":"36a4a219449b67485d7c819d6f88c75e162d6407e8da08b1f1741dc2e2480107"}
Sep 17 01:26:27.738736 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.738714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777766695f-9t4fs" event={"ID":"2258b4ab-625a-4636-8c3b-6cc11fd83396","Type":"ContainerStarted","Data":"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"}
Sep 17 01:26:27.738831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.738750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777766695f-9t4fs" event={"ID":"2258b4ab-625a-4636-8c3b-6cc11fd83396","Type":"ContainerStarted","Data":"f95a4a76553112814cca2ed8b20df08fec18885a386e7b80047f63a9d946e379"}
Sep 17 01:26:27.738831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.738814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:27.753542 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.753504    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ns6ht" podStartSLOduration=17.661389858 podStartE2EDuration="19.753490502s" totalImagesPullingTime="2.092100644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:26:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:26:27.752497714 +0000 UTC m=+286.396605830" watchObservedRunningTime="2026-09-17 01:26:27.753490502 +0000 UTC m=+286.397598596"
Sep 17 01:26:27.770931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:27.770884    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-777766695f-9t4fs" podStartSLOduration=284.770866343 podStartE2EDuration="4m44.770866343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:26:27.770048345 +0000 UTC m=+286.414156450" watchObservedRunningTime="2026-09-17 01:26:27.770866343 +0000 UTC m=+286.414974424"
Sep 17 01:26:28.036525 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.036402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:28.091174 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.091136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:28.252353 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.252311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:28.303753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.303674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:28.655434 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.655392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:28.845562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:28.845524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:29.336917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.336880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:29.746462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.746429    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6" event={"ID":"12ab0904-be5b-4ed1-a35b-447585b6bd17","Type":"ContainerStarted","Data":"5dd836536f287a1b4e343e762542adcd1ea964beb79a9780a1a2470fb2890bdd"}
Sep 17 01:26:29.748163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.748140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656wz" event={"ID":"c325a389-3781-4221-ac3f-f803aa9416af","Type":"ContainerStarted","Data":"9649c312fb82339115af946a5faf8c48589142ca552c3ab007da36b15c7c8c0d"}
Sep 17 01:26:29.748245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.748188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-656wz" event={"ID":"c325a389-3781-4221-ac3f-f803aa9416af","Type":"ContainerStarted","Data":"9a205ead2ef6507582043c769536ba603b1c888761b215a2d69fde53c8f3d7dc"}
Sep 17 01:26:29.748299 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.748277    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:29.760229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.760191    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8l7t6" podStartSLOduration=266.004302757 podStartE2EDuration="4m27.760178896s" totalImagesPullingTime="1.755876139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:26:29.759738224 +0000 UTC m=+288.403846323" watchObservedRunningTime="2026-09-17 01:26:29.760178896 +0000 UTC m=+288.404286975"
Sep 17 01:26:29.774457 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:29.774416    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-656wz" podStartSLOduration=251.0018334 podStartE2EDuration="4m12.774404144s" totalImagesPullingTime="1.772570744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:26:29.773840549 +0000 UTC m=+288.417948640" watchObservedRunningTime="2026-09-17 01:26:29.774404144 +0000 UTC m=+288.418512219"
Sep 17 01:26:30.256379 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:30.256349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:30.316455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:30.316429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:31.072831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:31.072801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:31.170460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:31.170429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:31.269505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:31.269481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:31.394307 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:31.394272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:31.443303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:31.443278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:33.763801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.763703    2573 generic.go:356] "Generic (PLEG): container finished" podID="6a6100e1-c44d-4fd1-91ba-48bf3daa239f" containerID="a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678" exitCode=255
Sep 17 01:26:33.763801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.763787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerDied","Data":"a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678"}
Sep 17 01:26:33.764257 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.763840    2573 scope.go:117] "RemoveContainer" containerID="5100d81dc595b73cfe65a9c93ec207bc549432959fbc3fcda425aef334435c16"
Sep 17 01:26:33.764257 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.764161    2573 scope.go:117] "RemoveContainer" containerID="a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678"
Sep 17 01:26:33.764345 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:33.764321    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-64c774bd44-xlj5x_open-cluster-management-agent-addon(6a6100e1-c44d-4fd1-91ba-48bf3daa239f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" podUID="6a6100e1-c44d-4fd1-91ba-48bf3daa239f"
Sep 17 01:26:33.765749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.765727    2573 generic.go:356] "Generic (PLEG): container finished" podID="88471754-d063-4011-a8fd-80e78e35f80d" containerID="1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899" exitCode=1
Sep 17 01:26:33.765851 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.765797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerDied","Data":"1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"}
Sep 17 01:26:33.766066 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.766054    2573 scope.go:117] "RemoveContainer" containerID="1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"
Sep 17 01:26:33.766202 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:33.766186    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-644f79fdfb-tvt5m_open-cluster-management-agent-addon(88471754-d063-4011-a8fd-80e78e35f80d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" podUID="88471754-d063-4011-a8fd-80e78e35f80d"
Sep 17 01:26:33.773721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.773705    2573 scope.go:117] "RemoveContainer" containerID="0f995f536c240530ae95164ea777c0ff353cb44575a03cc60823a6749ed40a03"
Sep 17 01:26:33.949718 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:33.949689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:34.011581 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:34.011554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:34.248867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:34.248840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:34.407613 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:34.407573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:26:34.770271 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:34.770244    2573 scope.go:117] "RemoveContainer" containerID="1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"
Sep 17 01:26:34.770652 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:34.770432    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-644f79fdfb-tvt5m_open-cluster-management-agent-addon(88471754-d063-4011-a8fd-80e78e35f80d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" podUID="88471754-d063-4011-a8fd-80e78e35f80d"
Sep 17 01:26:35.026254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:35.026174    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x"
Sep 17 01:26:35.026476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:35.026462    2573 scope.go:117] "RemoveContainer" containerID="a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678"
Sep 17 01:26:35.026604 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:35.026587    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-64c774bd44-xlj5x_open-cluster-management-agent-addon(6a6100e1-c44d-4fd1-91ba-48bf3daa239f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" podUID="6a6100e1-c44d-4fd1-91ba-48bf3daa239f"
Sep 17 01:26:35.032683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:35.032664    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:26:35.775423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:35.775397    2573 scope.go:117] "RemoveContainer" containerID="1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"
Sep 17 01:26:35.775803 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:35.775556    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-644f79fdfb-tvt5m_open-cluster-management-agent-addon(88471754-d063-4011-a8fd-80e78e35f80d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" podUID="88471754-d063-4011-a8fd-80e78e35f80d"
Sep 17 01:26:36.726238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:36.726205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.065202 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.065173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.297066 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.297037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.320417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.320331    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5kwnw"]
Sep 17 01:26:38.323734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.323716    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.326351 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.326331    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 01:26:38.326466 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.326447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 01:26:38.326699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.326679    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 01:26:38.326812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.326682    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 01:26:38.326812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.326686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 01:26:38.327500 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.327483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hlk7m\""
Sep 17 01:26:38.327581 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.327539    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 01:26:38.389145 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.389114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.466301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-wtmp\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-metrics-client-ca\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-sys\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nl78\" (UniqueName: \"kubernetes.io/projected/ccdcb991-fb29-44a8-8417-944283f102f7-kube-api-access-2nl78\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-textfile\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-tls\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.466671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.466583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-root\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.491282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.491246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.566989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.566955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-sys\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.566989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.566996    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567023    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nl78\" (UniqueName: \"kubernetes.io/projected/ccdcb991-fb29-44a8-8417-944283f102f7-kube-api-access-2nl78\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-textfile\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-sys\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-tls\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-root\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-wtmp\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-metrics-client-ca\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567598 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-root\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567598 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-wtmp\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567598 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-textfile\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567788 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-metrics-client-ca\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.567894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.567874    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.569319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.569299    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-tls\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.569435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.569413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccdcb991-fb29-44a8-8417-944283f102f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.574900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.574830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nl78\" (UniqueName: \"kubernetes.io/projected/ccdcb991-fb29-44a8-8417-944283f102f7-kube-api-access-2nl78\") pod \"node-exporter-5kwnw\" (UID: \"ccdcb991-fb29-44a8-8417-944283f102f7\") " pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.588193 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.588164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.633609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.633582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kwnw"
Sep 17 01:26:38.643628 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:26:38.643601    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdcb991_fb29_44a8_8417_944283f102f7.slice/crio-f6b59d45e60833022ecd440e73bea6a755c73ba275243bf597348f9e33494f6a WatchSource:0}: Error finding container f6b59d45e60833022ecd440e73bea6a755c73ba275243bf597348f9e33494f6a: Status 404 returned error can't find the container with id f6b59d45e60833022ecd440e73bea6a755c73ba275243bf597348f9e33494f6a
Sep 17 01:26:38.688106 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.688076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.785471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.785437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwnw" event={"ID":"ccdcb991-fb29-44a8-8417-944283f102f7","Type":"ContainerStarted","Data":"f6b59d45e60833022ecd440e73bea6a755c73ba275243bf597348f9e33494f6a"}
Sep 17 01:26:38.793902 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:26:38.793871    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-85vss" podUID="8c3c5fcf-0d87-459b-8ae4-c687356b9bdc"
Sep 17 01:26:38.821386 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.821359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:38.900574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:38.900538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:39.282838 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:39.282749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:39.360505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:39.360462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:39.753903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:39.753881    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-656wz"
Sep 17 01:26:39.790906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:39.790877    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwnw" event={"ID":"ccdcb991-fb29-44a8-8417-944283f102f7","Type":"ContainerStarted","Data":"bb781bdc23f23adf5ed998318cd60acc947f1a5cb952d1ab7a7721b461ecd7ca"}
Sep 17 01:26:40.469440 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:40.469391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:40.795511 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:40.795432    2573 generic.go:356] "Generic (PLEG): container finished" podID="ccdcb991-fb29-44a8-8417-944283f102f7" containerID="bb781bdc23f23adf5ed998318cd60acc947f1a5cb952d1ab7a7721b461ecd7ca" exitCode=0
Sep 17 01:26:40.795511 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:40.795483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwnw" event={"ID":"ccdcb991-fb29-44a8-8417-944283f102f7","Type":"ContainerDied","Data":"bb781bdc23f23adf5ed998318cd60acc947f1a5cb952d1ab7a7721b461ecd7ca"}
Sep 17 01:26:41.253090 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.253054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:41.331010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.330984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:41.435011 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.434959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:41.683852 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.683823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:41.717853 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.717831    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 01:26:41.732867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.732839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:41.802682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.802571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwnw" event={"ID":"ccdcb991-fb29-44a8-8417-944283f102f7","Type":"ContainerStarted","Data":"649628f1af2fbe6c8db32a4171e2b60010a3be07d89bec921c59324610b1e057"}
Sep 17 01:26:41.802682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.802615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwnw" event={"ID":"ccdcb991-fb29-44a8-8417-944283f102f7","Type":"ContainerStarted","Data":"7ad6273ed9fdcb049398ac0c3d487f7566da5babbdf4d1b3bda5c5a32a2e7b20"}
Sep 17 01:26:41.821366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:41.821325    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5kwnw" podStartSLOduration=2.705726785 podStartE2EDuration="3.821311214s" totalImagesPullingTime="1.052062327s" totalInitContainerRuntime="63.522102ms" isStatefulPod=true podCreationTimestamp="2026-09-17 01:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:26:41.819635069 +0000 UTC m=+300.463743158" watchObservedRunningTime="2026-09-17 01:26:41.821311214 +0000 UTC m=+300.465419293"
Sep 17 01:26:42.240447 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:42.240417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:43.077727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:43.077696    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:43.177361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:43.177330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:43.555979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:43.555948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:44.511032 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:44.510992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:45.048229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:45.048196    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" podUID="2c52d9a3-6999-4250-ae73-b2dea880eef5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:26:46.263918 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:46.263872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:47.332336 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:47.332305    2573 patch_prober.go:28] interesting pod/image-registry-777766695f-9t4fs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 01:26:47.332763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:47.332358    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-777766695f-9t4fs" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:26:47.369613 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:47.369584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:48.746738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:48.746707    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:26:48.793058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:48.793033    2573 scope.go:117] "RemoveContainer" containerID="1450f8de03125cfd1cc07193c4e0d8224a96ba12d76323925d3edf8a57803899"
Sep 17 01:26:48.869440 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:48.869401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:48.966333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:48.966297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:49.068762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.068677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:49.116143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.116116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:49.792834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.792807    2573 scope.go:117] "RemoveContainer" containerID="a39d3f62596a658843263472e6e47c7fd685a7304ad027c5d0522176f7b8b678"
Sep 17 01:26:49.826957 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.826930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m" event={"ID":"88471754-d063-4011-a8fd-80e78e35f80d","Type":"ContainerStarted","Data":"6f9b14c9941b93160091372c88612ac02c06914f96baaad56cd487c43cb6f0e7"}
Sep 17 01:26:49.827203 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.827179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:26:49.828738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:49.828717    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-644f79fdfb-tvt5m"
Sep 17 01:26:50.792571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:50.792540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:26:50.832507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:50.832474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c774bd44-xlj5x" event={"ID":"6a6100e1-c44d-4fd1-91ba-48bf3daa239f","Type":"ContainerStarted","Data":"c590d145abdffa406b0e15c6432bb1895b83d337adbae505c6cfdcb1b7cada64"}
Sep 17 01:26:52.079861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.079813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.178675 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.178642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.277447 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.277418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.641478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.641444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.742339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.742310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.812031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.812001    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:26:52.817027 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.817001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.881015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.880984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:52.979924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:52.979852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:55.048690 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:55.048653    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" podUID="2c52d9a3-6999-4250-ae73-b2dea880eef5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:26:55.910829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:55.910791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:26:55.963285 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:26:55.963256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:00.280764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:00.280734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:00.335689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:00.335661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:05.047754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.047714    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" podUID="2c52d9a3-6999-4250-ae73-b2dea880eef5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:27:05.048147 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.047813    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq"
Sep 17 01:27:05.048279 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.048250    2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e62510634fd5eb44c826a734a021569e5052ec4924a5b602856e7149f937fa17"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 17 01:27:05.048316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.048299    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" podUID="2c52d9a3-6999-4250-ae73-b2dea880eef5" containerName="service-proxy" containerID="cri-o://e62510634fd5eb44c826a734a021569e5052ec4924a5b602856e7149f937fa17" gracePeriod=30
Sep 17 01:27:05.383589 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.383548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:05.432738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.432711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:05.486185 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.486160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:05.882289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.882248    2573 generic.go:356] "Generic (PLEG): container finished" podID="2c52d9a3-6999-4250-ae73-b2dea880eef5" containerID="e62510634fd5eb44c826a734a021569e5052ec4924a5b602856e7149f937fa17" exitCode=2
Sep 17 01:27:05.882464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.882310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerDied","Data":"e62510634fd5eb44c826a734a021569e5052ec4924a5b602856e7149f937fa17"}
Sep 17 01:27:05.882464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:05.882354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76cb697b5b-r7cqq" event={"ID":"2c52d9a3-6999-4250-ae73-b2dea880eef5","Type":"ContainerStarted","Data":"305f3dd57ebf6d5ea75d623d3f5338d691fc5f6359eb23b518df3f68c3ac53c7"}
Sep 17 01:27:08.990812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:08.990764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:09.044145 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:09.044116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:13.533016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:13.532979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:15.277814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:15.277707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:15.328759 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:15.328732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:17.830439 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:17.830382    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-777766695f-9t4fs" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerName="registry" containerID="cri-o://dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278" gracePeriod=30
Sep 17 01:27:18.072297 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.072274    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:27:18.136007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.135975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136063    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136129    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgzp6\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted\") pod \"2258b4ab-625a-4636-8c3b-6cc11fd83396\" (UID: \"2258b4ab-625a-4636-8c3b-6cc11fd83396\") "
Sep 17 01:27:18.136591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136561    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:27:18.136661 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.136572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:27:18.138507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.138479    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:27:18.138644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.138622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:27:18.138714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.138685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6" (OuterVolumeSpecName: "kube-api-access-pgzp6") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "kube-api-access-pgzp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:27:18.138829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.138806    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:27:18.139271 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.139248    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:27:18.144824 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.144802    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2258b4ab-625a-4636-8c3b-6cc11fd83396" (UID: "2258b4ab-625a-4636-8c3b-6cc11fd83396"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:27:18.236747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236717    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-certificates\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236746    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgzp6\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-kube-api-access-pgzp6\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236757    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-image-registry-private-configuration\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236766    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2258b4ab-625a-4636-8c3b-6cc11fd83396-ca-trust-extracted\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236792    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-registry-tls\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236801    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2258b4ab-625a-4636-8c3b-6cc11fd83396-trusted-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236808    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2258b4ab-625a-4636-8c3b-6cc11fd83396-bound-sa-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.236914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.236815    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2258b4ab-625a-4636-8c3b-6cc11fd83396-installation-pull-secrets\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:27:18.924366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.924335    2573 generic.go:356] "Generic (PLEG): container finished" podID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerID="dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278" exitCode=0
Sep 17 01:27:18.924756 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.924375    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777766695f-9t4fs"
Sep 17 01:27:18.924756 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.924377    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777766695f-9t4fs" event={"ID":"2258b4ab-625a-4636-8c3b-6cc11fd83396","Type":"ContainerDied","Data":"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"}
Sep 17 01:27:18.924756 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.924508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777766695f-9t4fs" event={"ID":"2258b4ab-625a-4636-8c3b-6cc11fd83396","Type":"ContainerDied","Data":"f95a4a76553112814cca2ed8b20df08fec18885a386e7b80047f63a9d946e379"}
Sep 17 01:27:18.924756 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.924538    2573 scope.go:117] "RemoveContainer" containerID="dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"
Sep 17 01:27:18.932330 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.932315    2573 scope.go:117] "RemoveContainer" containerID="dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"
Sep 17 01:27:18.932619 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:27:18.932601    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278\": container with ID starting with dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278 not found: ID does not exist" containerID="dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"
Sep 17 01:27:18.932666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.932627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278"} err="failed to get container status \"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278\": rpc error: code = NotFound desc = could not find container \"dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278\": container with ID starting with dae002bb954eb4c0b5fb29c63512358826390f035f71d468cff4331fba599278 not found: ID does not exist"
Sep 17 01:27:18.948416 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.948394    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:27:18.952039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:18.952020    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-777766695f-9t4fs"]
Sep 17 01:27:19.796905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:19.796870    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" path="/var/lib/kubelet/pods/2258b4ab-625a-4636-8c3b-6cc11fd83396/volumes"
Sep 17 01:27:22.348310 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:22.348272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:22.399389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:22.399362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:54.383579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:54.383546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:54.434849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:54.434824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:55.692031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:55.691994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:27:55.694368 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:55.694332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c3c5fcf-0d87-459b-8ae4-c687356b9bdc-metrics-certs\") pod \"network-metrics-daemon-85vss\" (UID: \"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc\") " pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:27:55.895611 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:55.895582    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6hcd\""
Sep 17 01:27:55.903493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:55.903473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vss"
Sep 17 01:27:56.172343 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:56.172307    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-85vss"]
Sep 17 01:27:56.174977 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:27:56.174950    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3c5fcf_0d87_459b_8ae4_c687356b9bdc.slice/crio-c4c49dc48b7aae3548b824a717cf914f3ff1b29d08d0cca1bfd5c7fc11dcc3a8 WatchSource:0}: Error finding container c4c49dc48b7aae3548b824a717cf914f3ff1b29d08d0cca1bfd5c7fc11dcc3a8: Status 404 returned error can't find the container with id c4c49dc48b7aae3548b824a717cf914f3ff1b29d08d0cca1bfd5c7fc11dcc3a8
Sep 17 01:27:56.176989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:56.176972    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:27:57.053839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:57.053804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vss" event={"ID":"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc","Type":"ContainerStarted","Data":"c4c49dc48b7aae3548b824a717cf914f3ff1b29d08d0cca1bfd5c7fc11dcc3a8"}
Sep 17 01:27:58.062222 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:58.062185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vss" event={"ID":"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc","Type":"ContainerStarted","Data":"6116406bb472fed1e54b6d24693a0eedcfa5392dc37ecfbab97024854728ed3e"}
Sep 17 01:27:58.062626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:58.062278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vss" event={"ID":"8c3c5fcf-0d87-459b-8ae4-c687356b9bdc","Type":"ContainerStarted","Data":"20ec5c6753b466773017465ee35ebfa10668e4f97d62d641e402044fd90db497"}
Sep 17 01:27:58.076734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:58.076688    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-85vss" podStartSLOduration=374.999031559 podStartE2EDuration="6m16.076673584s" totalImagesPullingTime="1.077642025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:27:58.076234234 +0000 UTC m=+376.720342334" watchObservedRunningTime="2026-09-17 01:27:58.076673584 +0000 UTC m=+376.720781663"
Sep 17 01:27:58.154912 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:58.154876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:27:58.205428 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:27:58.205403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:06.288952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:06.288913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:06.340248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:06.340209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:15.283814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:15.283718    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:15.381289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:15.381258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:18.331709 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:18.331676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:18.383096 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:18.383068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:19.147928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:19.147893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:19.298295 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:19.298257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:19.343854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:19.343824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:19.891245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:19.891213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:19.991513 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:19.991476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:29.750123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:29.750080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:29.796129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:29.796097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:29.854535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:29.854506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:29.903362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:29.903344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:54.993381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:54.993350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:28:55.044955 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:28:55.044926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:02.872662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:02.872599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:02.968755 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:02.968724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:09.016006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:09.015920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:29.009356 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:29.009325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:29.097926 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:29.097896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:29.499264 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:29.499222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:30.323311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:30.323276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:33.105659 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:33.105605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:33.164382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:33.164340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:34.891046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:34.891016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:35.001979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:35.001939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:35.369321 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:35.369284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:35.470919 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:35.470868    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:36.894118 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:36.894083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:37.295623 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:37.295543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:40.102290 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:40.102257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:40.155520 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:40.155493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:41.969380 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:41.969338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:42.025477 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:42.025452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:45.690198 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:45.690167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:46.815966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.815937    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96l9w"]
Sep 17 01:29:46.816314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.816138    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerName="registry"
Sep 17 01:29:46.816314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.816148    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerName="registry"
Sep 17 01:29:46.816314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.816196    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2258b4ab-625a-4636-8c3b-6cc11fd83396" containerName="registry"
Sep 17 01:29:46.818843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.818827    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:46.821794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.821755    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96l9w"]
Sep 17 01:29:46.821925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.821841    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tlgrf\""
Sep 17 01:29:46.821925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.821869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 01:29:46.822149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.822134    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 01:29:46.936666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.936631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-bound-sa-token\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:46.936666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:46.936669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zgp\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-kube-api-access-h8zgp\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.037728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.037683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-bound-sa-token\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.037728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.037728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zgp\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-kube-api-access-h8zgp\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.045331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.045300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-bound-sa-token\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.045804 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.045756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zgp\" (UniqueName: \"kubernetes.io/projected/2e914a0f-5911-4129-8912-70933271b421-kube-api-access-h8zgp\") pod \"cert-manager-55b4d954d5-96l9w\" (UID: \"2e914a0f-5911-4129-8912-70933271b421\") " pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.128133 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.128110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-96l9w"
Sep 17 01:29:47.397324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.397249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96l9w"]
Sep 17 01:29:47.400426 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:29:47.400396    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e914a0f_5911_4129_8912_70933271b421.slice/crio-3d5708f4df25901080796e45a3b675e505c673d34c9ecc23ec9859ce205923d7 WatchSource:0}: Error finding container 3d5708f4df25901080796e45a3b675e505c673d34c9ecc23ec9859ce205923d7: Status 404 returned error can't find the container with id 3d5708f4df25901080796e45a3b675e505c673d34c9ecc23ec9859ce205923d7
Sep 17 01:29:47.416575 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:47.416552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-96l9w" event={"ID":"2e914a0f-5911-4129-8912-70933271b421","Type":"ContainerStarted","Data":"3d5708f4df25901080796e45a3b675e505c673d34c9ecc23ec9859ce205923d7"}
Sep 17 01:29:51.433461 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:51.433415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-96l9w" event={"ID":"2e914a0f-5911-4129-8912-70933271b421","Type":"ContainerStarted","Data":"91af43a4d6db5ff7e6cb89e5bd907a0168b653d2d59de8c9427e1c93a010c2e1"}
Sep 17 01:29:51.448319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:51.448279    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-96l9w" podStartSLOduration=2.418189569 podStartE2EDuration="5.4482625s" totalImagesPullingTime="3.030072931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:29:51.446831514 +0000 UTC m=+490.090939604" watchObservedRunningTime="2026-09-17 01:29:51.4482625 +0000 UTC m=+490.092370579"
Sep 17 01:29:51.716689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:51.716609    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:51.815123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:51.815097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:57.870628 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:57.870594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:29:57.969218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:29:57.969189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:00.043294 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:00.043267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:18.289155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:18.289125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:18.372091 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:18.372055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:22.776898 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:22.776864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.085724 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.085689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.192021 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.191992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.677111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.677078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.882929 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.882897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.995488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.995413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:30.996980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:30.996956    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"]
Sep 17 01:30:31.001034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.001019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.003672 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.003653    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 01:30:31.003794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.003693    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 01:30:31.003914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.003896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x4nvm\""
Sep 17 01:30:31.003959 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.003910    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 01:30:31.005266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.005252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 01:30:31.019156 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.019132    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"]
Sep 17 01:30:31.123260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.123223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.130001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.129983    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.130073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.130019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42x9\" (UniqueName: \"kubernetes.io/projected/66a25ffb-26b7-48b4-90ee-e59980c51937-kube-api-access-w42x9\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.130073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.130039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-tmp\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.130142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.130097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.130142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.130113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-manifests\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.222439 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.222412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.230543 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.230517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.230691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.230559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42x9\" (UniqueName: \"kubernetes.io/projected/66a25ffb-26b7-48b4-90ee-e59980c51937-kube-api-access-w42x9\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.230691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.230580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-tmp\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.230691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.230604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.230691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.230627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-manifests\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.231085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.231062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-manifests\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.232760 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.232741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66a25ffb-26b7-48b4-90ee-e59980c51937-tmp\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.232853 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.232837    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.232976 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.232960    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66a25ffb-26b7-48b4-90ee-e59980c51937-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.238475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.238455    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42x9\" (UniqueName: \"kubernetes.io/projected/66a25ffb-26b7-48b4-90ee-e59980c51937-kube-api-access-w42x9\") pod \"opendatahub-operator-controller-manager-57c6978585-466dj\" (UID: \"66a25ffb-26b7-48b4-90ee-e59980c51937\") " pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.278589 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.278537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.311539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.311521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:31.382453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.382420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.479054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.479003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.581479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.581299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:31.581542 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.581516    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"]
Sep 17 01:30:31.584150 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:30:31.584129    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a25ffb_26b7_48b4_90ee_e59980c51937.slice/crio-c283b39686dc8b6edc32e7629c672f42aaaafabf691c5533a6e096830bc2c68f WatchSource:0}: Error finding container c283b39686dc8b6edc32e7629c672f42aaaafabf691c5533a6e096830bc2c68f: Status 404 returned error can't find the container with id c283b39686dc8b6edc32e7629c672f42aaaafabf691c5533a6e096830bc2c68f
Sep 17 01:30:31.681045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:31.681019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:32.574606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:32.574569    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj" event={"ID":"66a25ffb-26b7-48b4-90ee-e59980c51937","Type":"ContainerStarted","Data":"c283b39686dc8b6edc32e7629c672f42aaaafabf691c5533a6e096830bc2c68f"}
Sep 17 01:30:35.586514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:35.586477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj" event={"ID":"66a25ffb-26b7-48b4-90ee-e59980c51937","Type":"ContainerStarted","Data":"a3932a8c4b7ea1a509beffe478b91efb737da839e6d4872c5769d2892bcd853a"}
Sep 17 01:30:36.591025 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:36.590988    2573 generic.go:356] "Generic (PLEG): container finished" podID="66a25ffb-26b7-48b4-90ee-e59980c51937" containerID="a3932a8c4b7ea1a509beffe478b91efb737da839e6d4872c5769d2892bcd853a" exitCode=0
Sep 17 01:30:36.591385 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:36.591071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj" event={"ID":"66a25ffb-26b7-48b4-90ee-e59980c51937","Type":"ContainerDied","Data":"a3932a8c4b7ea1a509beffe478b91efb737da839e6d4872c5769d2892bcd853a"}
Sep 17 01:30:37.498849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:37.498816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:37.596243 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:37.596211    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj" event={"ID":"66a25ffb-26b7-48b4-90ee-e59980c51937","Type":"ContainerStarted","Data":"ad0a40847388fdd0f6e881107bb6407a8de59ba43dade67d7a6dc96db922c9dc"}
Sep 17 01:30:37.596610 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:37.596355    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:37.620522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:37.620028    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj" podStartSLOduration=3.190581711 podStartE2EDuration="7.620009492s" totalImagesPullingTime="3.346774596s" totalInitContainerRuntime="1.082653185s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:30:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:30:37.61818317 +0000 UTC m=+536.262291260" watchObservedRunningTime="2026-09-17 01:30:37.620009492 +0000 UTC m=+536.264117575"
Sep 17 01:30:48.602402 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:48.602368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57c6978585-466dj"
Sep 17 01:30:49.508248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:49.508205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:50.219591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.219553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:50.330906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.330875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:50.528908 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.528819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:50.536213 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.536181    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"]
Sep 17 01:30:50.543987 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.543960    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.547566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.547537    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 01:30:50.547738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.547662    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 01:30:50.548194 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.548178    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 01:30:50.548728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.548713    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 01:30:50.554445 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.554424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"]
Sep 17 01:30:50.671345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.671315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/979374ce-fbd1-4aee-8296-dc327e265c62-tls-certs\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.671494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.671358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd69d\" (UniqueName: \"kubernetes.io/projected/979374ce-fbd1-4aee-8296-dc327e265c62-kube-api-access-zd69d\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.671494 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.671423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979374ce-fbd1-4aee-8296-dc327e265c62-tmp\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.772709 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.772678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd69d\" (UniqueName: \"kubernetes.io/projected/979374ce-fbd1-4aee-8296-dc327e265c62-kube-api-access-zd69d\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.772867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.772718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979374ce-fbd1-4aee-8296-dc327e265c62-tmp\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.772867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.772748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/979374ce-fbd1-4aee-8296-dc327e265c62-tls-certs\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.775102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.775076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979374ce-fbd1-4aee-8296-dc327e265c62-tmp\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.775214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.775198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/979374ce-fbd1-4aee-8296-dc327e265c62-tls-certs\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.782457 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.782407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd69d\" (UniqueName: \"kubernetes.io/projected/979374ce-fbd1-4aee-8296-dc327e265c62-kube-api-access-zd69d\") pod \"kube-auth-proxy-6c5f54bcb9-mmxtz\" (UID: \"979374ce-fbd1-4aee-8296-dc327e265c62\") " pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:50.824828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.824799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:50.852586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:50.852567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"
Sep 17 01:30:51.122605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.122580    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz"]
Sep 17 01:30:51.124629 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:30:51.124604    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979374ce_fbd1_4aee_8296_dc327e265c62.slice/crio-4b0b24f2873c3917b9b7c6e43362e6b1786b52dc9484c4212efa9ac225e9e8cd WatchSource:0}: Error finding container 4b0b24f2873c3917b9b7c6e43362e6b1786b52dc9484c4212efa9ac225e9e8cd: Status 404 returned error can't find the container with id 4b0b24f2873c3917b9b7c6e43362e6b1786b52dc9484c4212efa9ac225e9e8cd
Sep 17 01:30:51.645860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.645826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz" event={"ID":"979374ce-fbd1-4aee-8296-dc327e265c62","Type":"ContainerStarted","Data":"4b0b24f2873c3917b9b7c6e43362e6b1786b52dc9484c4212efa9ac225e9e8cd"}
Sep 17 01:30:51.714602 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.714568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:51.728299 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.728274    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:30:51.732466 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.732451    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.735262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.735242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bh2ff\""
Sep 17 01:30:51.735369 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.735336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 01:30:51.735423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.735378    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 01:30:51.735664 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.735651    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 01:30:51.735799 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.735766    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 01:30:51.744496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.744476    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:30:51.812669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.812638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:51.880361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkppr\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.880682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.880663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981766    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkppr\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.981989 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.981905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.982829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.982753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.984850 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.984804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.984965 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.984844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.984965 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.984880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.984965 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.984912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.989664 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.989644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:51.990054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:51.990027    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkppr\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr\") pod \"istiod-openshift-gateway-7b7995d5cd-xnxq2\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:52.041722 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:52.041689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:52.327830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:52.327730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:30:52.331382 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:30:52.331351    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1629431a_16d9_42dc_a305_f5c9ecb7893c.slice/crio-d6f8544e5c70b21f1f6292dc44628f76193c9004a9f944d18cbcf25ef0fd578b WatchSource:0}: Error finding container d6f8544e5c70b21f1f6292dc44628f76193c9004a9f944d18cbcf25ef0fd578b: Status 404 returned error can't find the container with id d6f8544e5c70b21f1f6292dc44628f76193c9004a9f944d18cbcf25ef0fd578b
Sep 17 01:30:52.583932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:52.583847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:52.651680 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:52.651644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" event={"ID":"1629431a-16d9-42dc-a305-f5c9ecb7893c","Type":"ContainerStarted","Data":"d6f8544e5c70b21f1f6292dc44628f76193c9004a9f944d18cbcf25ef0fd578b"}
Sep 17 01:30:54.662736 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:54.662696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz" event={"ID":"979374ce-fbd1-4aee-8296-dc327e265c62","Type":"ContainerStarted","Data":"c660fe8070ec99c82093d249ca7ee0a24bdda26f4648ed198521b604d3398639"}
Sep 17 01:30:54.677793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:54.677722    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz" podStartSLOduration=1.79623381 podStartE2EDuration="4.677703135s" totalImagesPullingTime="2.881469325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:30:54.67642999 +0000 UTC m=+553.320538090" watchObservedRunningTime="2026-09-17 01:30:54.677703135 +0000 UTC m=+553.321811214"
Sep 17 01:30:55.766552 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:55.766508    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:30:55.766875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:55.766579    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:30:56.672820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.672747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" event={"ID":"1629431a-16d9-42dc-a305-f5c9ecb7893c","Type":"ContainerStarted","Data":"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"}
Sep 17 01:30:56.672979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.672942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:56.674476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.674452    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-xnxq2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:30:56.674596 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.674496    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:30:56.692526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.692317    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" podStartSLOduration=2.260255037 podStartE2EDuration="5.692280639s" totalImagesPullingTime="3.432025602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:30:56.690135646 +0000 UTC m=+555.334243753" watchObservedRunningTime="2026-09-17 01:30:56.692280639 +0000 UTC m=+555.336388720"
Sep 17 01:30:56.740516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.740483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:56.803309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:56.803278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:57.317427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:57.317397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:57.511651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:57.511618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:30:57.677072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:57.677048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:30:57.796312 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:30:57.796280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:01.192124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:01.192083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:01.288648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:01.288611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:01.393680 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:01.393648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:01.501320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:01.501250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:01.868982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:01.868947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:08.067220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.067183    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"]
Sep 17 01:31:08.141030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.140990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"]
Sep 17 01:31:08.141193 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.141094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzkg\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-kube-api-access-8gzkg\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.199827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.200029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.199855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.300968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301243 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzkg\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-kube-api-access-8gzkg\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301294 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301294 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.301389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.301348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.302199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.302168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.303481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.303461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.303564 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.303484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.303605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.303572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.303642 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.303605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.309342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.309316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.309577 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.309559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzkg\" (UniqueName: \"kubernetes.io/projected/a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0-kube-api-access-8gzkg\") pod \"istiod-openshift-gateway-5677ccb49b-b92x9\" (UID: \"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.449713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.449665    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:08.722653 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.722578    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"]
Sep 17 01:31:08.725487 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:31:08.725460    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bd0c38_3ad0_4a0f_8058_fe96aae22bc0.slice/crio-512739112d5ab91626e70945390f4ff31665336daac5162ec216db2224786096 WatchSource:0}: Error finding container 512739112d5ab91626e70945390f4ff31665336daac5162ec216db2224786096: Status 404 returned error can't find the container with id 512739112d5ab91626e70945390f4ff31665336daac5162ec216db2224786096
Sep 17 01:31:08.728452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.728417    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:31:08.728517 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:08.728497    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:31:09.717416 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.717380    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9" event={"ID":"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0","Type":"ContainerStarted","Data":"082a5ffcf4ae0bcd9a77e3601d8d120fe5a0d7120a09ec509aaf0ad4e03a9335"}
Sep 17 01:31:09.717890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.717428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9" event={"ID":"a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0","Type":"ContainerStarted","Data":"512739112d5ab91626e70945390f4ff31665336daac5162ec216db2224786096"}
Sep 17 01:31:09.717890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.717579    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:09.719239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.719217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9"
Sep 17 01:31:09.759092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.759046    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9" podStartSLOduration=1.759031808 podStartE2EDuration="1.759031808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:31:09.73903317 +0000 UTC m=+568.383141260" watchObservedRunningTime="2026-09-17 01:31:09.759031808 +0000 UTC m=+568.403139886"
Sep 17 01:31:09.785843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.785815    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:31:09.786005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:09.785983    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerName="discovery" containerID="cri-o://469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625" gracePeriod=30
Sep 17 01:31:10.017311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.017289    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:31:10.114342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114313    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114345    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114402    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114530    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkppr\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114678    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert\") pod \"1629431a-16d9-42dc-a305-f5c9ecb7893c\" (UID: \"1629431a-16d9-42dc-a305-f5c9ecb7893c\") "
Sep 17 01:31:10.114841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:31:10.114943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.114922    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-ca-configmap\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.116808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.116785    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:31:10.116917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.116833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:31:10.117065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.117021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs" (OuterVolumeSpecName: "local-certs") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:31:10.117065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.117034    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts" (OuterVolumeSpecName: "cacerts") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:31:10.117153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.117103    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:31:10.117153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.117110    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr" (OuterVolumeSpecName: "kube-api-access-wkppr") pod "1629431a-16d9-42dc-a305-f5c9ecb7893c" (UID: "1629431a-16d9-42dc-a305-f5c9ecb7893c"). InnerVolumeSpecName "kube-api-access-wkppr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:31:10.215506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215467    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-csr-dns-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.215506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215502    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-cacerts\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.215691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215515    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1629431a-16d9-42dc-a305-f5c9ecb7893c-local-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.215691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215528    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-kubeconfig\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.215691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215539    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.215691 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.215549    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkppr\" (UniqueName: \"kubernetes.io/projected/1629431a-16d9-42dc-a305-f5c9ecb7893c-kube-api-access-wkppr\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:31:10.604030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.603995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:10.651267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.651234    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"]
Sep 17 01:31:10.651508 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.651495    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerName="discovery"
Sep 17 01:31:10.651570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.651510    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerName="discovery"
Sep 17 01:31:10.651570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.651562    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerName="discovery"
Sep 17 01:31:10.653433 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.653415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:10.656519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.656493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 17 01:31:10.656639 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.656497    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5tq9z\""
Sep 17 01:31:10.667113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.667088    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"]
Sep 17 01:31:10.669932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.669909    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"]
Sep 17 01:31:10.676458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.676435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.679050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.679032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 17 01:31:10.679174 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.679128    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xt7v8\""
Sep 17 01:31:10.684924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.684894    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"]
Sep 17 01:31:10.692813 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.692768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:10.718663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.718635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.719110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.718694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrc7\" (UniqueName: \"kubernetes.io/projected/375db05b-cad3-4312-acd1-03c1d90297e6-kube-api-access-bsrc7\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:10.719110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.718763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvz6j\" (UniqueName: \"kubernetes.io/projected/3fe56468-86fa-4fdb-a54b-25942b3c9949-kube-api-access-xvz6j\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.719110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.718831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:10.723395 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.723369    2573 generic.go:356] "Generic (PLEG): container finished" podID="1629431a-16d9-42dc-a305-f5c9ecb7893c" containerID="469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625" exitCode=0
Sep 17 01:31:10.723478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.723425    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"
Sep 17 01:31:10.723478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.723452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" event={"ID":"1629431a-16d9-42dc-a305-f5c9ecb7893c","Type":"ContainerDied","Data":"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"}
Sep 17 01:31:10.723549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.723497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2" event={"ID":"1629431a-16d9-42dc-a305-f5c9ecb7893c","Type":"ContainerDied","Data":"d6f8544e5c70b21f1f6292dc44628f76193c9004a9f944d18cbcf25ef0fd578b"}
Sep 17 01:31:10.723549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.723517    2573 scope.go:117] "RemoveContainer" containerID="469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"
Sep 17 01:31:10.732336 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.732226    2573 scope.go:117] "RemoveContainer" containerID="469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"
Sep 17 01:31:10.732563 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:31:10.732540    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625\": container with ID starting with 469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625 not found: ID does not exist" containerID="469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"
Sep 17 01:31:10.732618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.732577    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625"} err="failed to get container status \"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625\": rpc error: code = NotFound desc = could not find container \"469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625\": container with ID starting with 469097e0572ffbd35522ecacf9d759a7dae7d51663fa58b517404ade8f9be625 not found: ID does not exist"
Sep 17 01:31:10.746687 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.746657    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:31:10.752430 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.752411    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2"]
Sep 17 01:31:10.819753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.819730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz6j\" (UniqueName: \"kubernetes.io/projected/3fe56468-86fa-4fdb-a54b-25942b3c9949-kube-api-access-xvz6j\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.819873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.819793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:10.819873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.819835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.819873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.819863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrc7\" (UniqueName: \"kubernetes.io/projected/375db05b-cad3-4312-acd1-03c1d90297e6-kube-api-access-bsrc7\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:10.820022 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:31:10.819901    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 17 01:31:10.820022 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:31:10.819964    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert podName:375db05b-cad3-4312-acd1-03c1d90297e6 nodeName:}" failed. No retries permitted until 2026-09-17 01:31:11.31994475 +0000 UTC m=+569.964052810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert") pod "kserve-controller-manager-d6f4b65b8-qhxlj" (UID: "375db05b-cad3-4312-acd1-03c1d90297e6") : secret "kserve-webhook-server-cert" not found
Sep 17 01:31:10.820022 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:31:10.819990    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 01:31:10.820155 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:31:10.820047    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert podName:3fe56468-86fa-4fdb-a54b-25942b3c9949 nodeName:}" failed. No retries permitted until 2026-09-17 01:31:11.32003077 +0000 UTC m=+569.964138832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert") pod "llmisvc-controller-manager-777c6bd7d5-jq455" (UID: "3fe56468-86fa-4fdb-a54b-25942b3c9949") : secret "llmisvc-webhook-server-cert" not found
Sep 17 01:31:10.834583 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.834564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvz6j\" (UniqueName: \"kubernetes.io/projected/3fe56468-86fa-4fdb-a54b-25942b3c9949-kube-api-access-xvz6j\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:10.834681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:10.834586    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrc7\" (UniqueName: \"kubernetes.io/projected/375db05b-cad3-4312-acd1-03c1d90297e6-kube-api-access-bsrc7\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:11.074029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.073949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:11.140308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.140277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:11.323873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.323841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:11.324055 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.323878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:11.326242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.326211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/375db05b-cad3-4312-acd1-03c1d90297e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhxlj\" (UID: \"375db05b-cad3-4312-acd1-03c1d90297e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:11.326382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.326342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fe56468-86fa-4fdb-a54b-25942b3c9949-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jq455\" (UID: \"3fe56468-86fa-4fdb-a54b-25942b3c9949\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:11.563791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.563738    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:11.586519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.586438    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:11.797914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.797884    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1629431a-16d9-42dc-a305-f5c9ecb7893c" path="/var/lib/kubelet/pods/1629431a-16d9-42dc-a305-f5c9ecb7893c/volumes"
Sep 17 01:31:11.834330 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.834306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"]
Sep 17 01:31:11.836595 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:31:11.836530    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375db05b_cad3_4312_acd1_03c1d90297e6.slice/crio-3b63bd569109671731b04aa93a5b20e7aa2daf9aac4c801a6946b7dac427799d WatchSource:0}: Error finding container 3b63bd569109671731b04aa93a5b20e7aa2daf9aac4c801a6946b7dac427799d: Status 404 returned error can't find the container with id 3b63bd569109671731b04aa93a5b20e7aa2daf9aac4c801a6946b7dac427799d
Sep 17 01:31:11.863793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.863746    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"]
Sep 17 01:31:11.866753 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:31:11.866731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3fe56468_86fa_4fdb_a54b_25942b3c9949.slice/crio-3b3ce3a85c1a47490f606496bbbc96dcf9dc5da1e8a3c7317faa1a3487918e05 WatchSource:0}: Error finding container 3b3ce3a85c1a47490f606496bbbc96dcf9dc5da1e8a3c7317faa1a3487918e05: Status 404 returned error can't find the container with id 3b3ce3a85c1a47490f606496bbbc96dcf9dc5da1e8a3c7317faa1a3487918e05
Sep 17 01:31:11.880686 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:11.880656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:12.018993 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:12.018967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:12.119251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:12.119226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:12.734475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:12.734435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455" event={"ID":"3fe56468-86fa-4fdb-a54b-25942b3c9949","Type":"ContainerStarted","Data":"3b3ce3a85c1a47490f606496bbbc96dcf9dc5da1e8a3c7317faa1a3487918e05"}
Sep 17 01:31:12.735830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:12.735803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj" event={"ID":"375db05b-cad3-4312-acd1-03c1d90297e6","Type":"ContainerStarted","Data":"3b63bd569109671731b04aa93a5b20e7aa2daf9aac4c801a6946b7dac427799d"}
Sep 17 01:31:15.755352 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.755311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455" event={"ID":"3fe56468-86fa-4fdb-a54b-25942b3c9949","Type":"ContainerStarted","Data":"edbba46e8166e2eb8b34974182ac8b411b96f17efb782f7ccfea39a8c089b91d"}
Sep 17 01:31:15.755818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.755483    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:15.756725 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.756700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj" event={"ID":"375db05b-cad3-4312-acd1-03c1d90297e6","Type":"ContainerStarted","Data":"2add32732e82a74e7ced5ef35ea542eca24b5ec8df94fec7e23b74bb6ca2f4c3"}
Sep 17 01:31:15.756847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.756758    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:15.772217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.772169    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455" podStartSLOduration=2.767495697 podStartE2EDuration="5.772151511s" totalImagesPullingTime="3.004655814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:31:15.770237298 +0000 UTC m=+574.414345389" watchObservedRunningTime="2026-09-17 01:31:15.772151511 +0000 UTC m=+574.416259594"
Sep 17 01:31:15.785242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:15.785201    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj" podStartSLOduration=2.753786055 podStartE2EDuration="5.785187419s" totalImagesPullingTime="3.031401364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:31:15.784568813 +0000 UTC m=+574.428676919" watchObservedRunningTime="2026-09-17 01:31:15.785187419 +0000 UTC m=+574.429295496"
Sep 17 01:31:18.766195 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:18.766155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:43.878940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:43.878903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:43.979624 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:43.979593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:46.763099 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:46.763069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jq455"
Sep 17 01:31:46.766267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:46.766241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhxlj"
Sep 17 01:31:54.806341 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:54.806302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:56.019701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:56.019667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:57.730694 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:57.730661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:59.681750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:59.681716    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:31:59.730911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:31:59.730881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:02.365012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:02.364980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:02.457259 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:02.457226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:15.047904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:15.047862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:15.841609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:15.841579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:16.634609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:16.634559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:21.004322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:21.004280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:21.097614 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:21.097578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:21.649727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:21.649693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:23.519529 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.519491    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"]
Sep 17 01:32:23.522766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.522749    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:23.525651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.525627    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 01:32:23.525766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.525661    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 01:32:23.526647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.526616    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xbjcm\""
Sep 17 01:32:23.530421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.530391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"]
Sep 17 01:32:23.540502 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.540478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49jp\" (UniqueName: \"kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp\") pod \"limitador-operator-controller-manager-74495c69f8-qb5gh\" (UID: \"2eb41127-6b44-4355-a6f5-8188b5cbe67e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:23.641787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.641731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49jp\" (UniqueName: \"kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp\") pod \"limitador-operator-controller-manager-74495c69f8-qb5gh\" (UID: \"2eb41127-6b44-4355-a6f5-8188b5cbe67e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:23.652693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.652667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49jp\" (UniqueName: \"kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp\") pod \"limitador-operator-controller-manager-74495c69f8-qb5gh\" (UID: \"2eb41127-6b44-4355-a6f5-8188b5cbe67e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:23.833422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:23.833343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:24.104061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:24.104036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"]
Sep 17 01:32:24.109103 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:32:24.109071    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb41127_6b44_4355_a6f5_8188b5cbe67e.slice/crio-8b6137f6694a1992833173b1e9dcea2a3a6cfca9a022e4bf9d36f3bce870f808 WatchSource:0}: Error finding container 8b6137f6694a1992833173b1e9dcea2a3a6cfca9a022e4bf9d36f3bce870f808: Status 404 returned error can't find the container with id 8b6137f6694a1992833173b1e9dcea2a3a6cfca9a022e4bf9d36f3bce870f808
Sep 17 01:32:24.676377 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:24.676342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:25.013750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:25.013668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh" event={"ID":"2eb41127-6b44-4355-a6f5-8188b5cbe67e","Type":"ContainerStarted","Data":"8b6137f6694a1992833173b1e9dcea2a3a6cfca9a022e4bf9d36f3bce870f808"}
Sep 17 01:32:26.889347 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:26.889316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:27.030671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:27.030585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh" event={"ID":"2eb41127-6b44-4355-a6f5-8188b5cbe67e","Type":"ContainerStarted","Data":"4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629"}
Sep 17 01:32:27.030823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:27.030713    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:27.038060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:27.038032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:27.052600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:27.052555    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh" podStartSLOduration=1.437304306 podStartE2EDuration="4.052541575s" totalImagesPullingTime="2.615237269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:32:27.05151989 +0000 UTC m=+645.695627988" watchObservedRunningTime="2026-09-17 01:32:27.052541575 +0000 UTC m=+645.696649654"
Sep 17 01:32:27.850721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:27.850689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:28.885899 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:28.885869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:31.297064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:31.297032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:31.833999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:31.833972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:32.023127 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:32.023094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:33.449697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:33.449661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:33.550457 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:33.550425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:33.650184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:33.650151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:33.707170 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:33.707102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:34.649633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:34.649576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:34.750961 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:34.750933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:38.037161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:38.037128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:42.082187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.082156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:42.186968 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.186936    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"]
Sep 17 01:32:42.193509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.193489    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.196154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.196134    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kl65s\""
Sep 17 01:32:42.208749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.208727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"]
Sep 17 01:32:42.230929 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.230895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:42.276030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.276006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.276102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.276039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c8mf\" (UniqueName: \"kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.376896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.376873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.377037 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.376905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8mf\" (UniqueName: \"kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.377226 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.377209    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.384837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.384808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c8mf\" (UniqueName: \"kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf\") pod \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.502678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.502647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:42.780088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.780062    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"]
Sep 17 01:32:42.782804 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:32:42.782760    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076805bd_fc74_41bf_b5c3_93426fc4201b.slice/crio-0a8de11d1945dd04586afc62ff212ae92ece382669ef51e61bf649ef1173b8cd WatchSource:0}: Error finding container 0a8de11d1945dd04586afc62ff212ae92ece382669ef51e61bf649ef1173b8cd: Status 404 returned error can't find the container with id 0a8de11d1945dd04586afc62ff212ae92ece382669ef51e61bf649ef1173b8cd
Sep 17 01:32:42.941524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.941493    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"]
Sep 17 01:32:42.948185 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.948152    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"]
Sep 17 01:32:42.968201 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.968174    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:32:42.973512 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.973493    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:42.989303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.989280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:32:42.993170 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.993146    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"]
Sep 17 01:32:42.993412 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:42.993384    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" containerName="manager" containerID="cri-o://4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629" gracePeriod=2
Sep 17 01:32:43.000442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.000421    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"]
Sep 17 01:32:43.015217 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:43.015188    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qb5gh\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:43.082108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.082039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.082108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.082085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sksdn\" (UniqueName: \"kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.183449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.183416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.183583 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.183471    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sksdn\" (UniqueName: \"kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.183818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.183799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.191928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.191902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sksdn\" (UniqueName: \"kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn\") pod \"kuadrant-operator-controller-manager-5f685c496f-llgs2\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.215853 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.215833    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:43.218228 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:43.218187    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qb5gh\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:43.284162 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.284133    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:43.284295 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.284204    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s49jp\" (UniqueName: \"kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp\") pod \"2eb41127-6b44-4355-a6f5-8188b5cbe67e\" (UID: \"2eb41127-6b44-4355-a6f5-8188b5cbe67e\") "
Sep 17 01:32:43.286615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.286588    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp" (OuterVolumeSpecName: "kube-api-access-s49jp") pod "2eb41127-6b44-4355-a6f5-8188b5cbe67e" (UID: "2eb41127-6b44-4355-a6f5-8188b5cbe67e"). InnerVolumeSpecName "kube-api-access-s49jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:32:43.385452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.385417    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s49jp\" (UniqueName: \"kubernetes.io/projected/2eb41127-6b44-4355-a6f5-8188b5cbe67e-kube-api-access-s49jp\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:32:43.568570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.568354    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:32:43.571453 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:32:43.571424    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9d631b_54b3_4160_918c_8d7e8419043a.slice/crio-fb353631b0d82a7cffe839407d90c83e03259a7100ef4925548d894b1239c752 WatchSource:0}: Error finding container fb353631b0d82a7cffe839407d90c83e03259a7100ef4925548d894b1239c752: Status 404 returned error can't find the container with id fb353631b0d82a7cffe839407d90c83e03259a7100ef4925548d894b1239c752
Sep 17 01:32:43.798576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:43.798543    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" path="/var/lib/kubelet/pods/2eb41127-6b44-4355-a6f5-8188b5cbe67e/volumes"
Sep 17 01:32:44.102734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.102651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" event={"ID":"5e9d631b-54b3-4160-918c-8d7e8419043a","Type":"ContainerStarted","Data":"fb353631b0d82a7cffe839407d90c83e03259a7100ef4925548d894b1239c752"}
Sep 17 01:32:44.104064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.104037    2573 generic.go:356] "Generic (PLEG): container finished" podID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" containerID="4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629" exitCode=0
Sep 17 01:32:44.104191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.104085    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qb5gh"
Sep 17 01:32:44.104191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.104143    2573 scope.go:117] "RemoveContainer" containerID="4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629"
Sep 17 01:32:44.111952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.111936    2573 scope.go:117] "RemoveContainer" containerID="4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629"
Sep 17 01:32:44.112225 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:44.112200    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629\": container with ID starting with 4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629 not found: ID does not exist" containerID="4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629"
Sep 17 01:32:44.112279 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.112236    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629"} err="failed to get container status \"4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629\": rpc error: code = NotFound desc = could not find container \"4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629\": container with ID starting with 4f0da9bc698e334246337bbcea1b1f1c41b8f92b903c3698af3a72ac670be629 not found: ID does not exist"
Sep 17 01:32:44.536745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.536702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:44.636683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:44.636650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:50.135206 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.135170    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" containerName="manager" containerID="cri-o://a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842" gracePeriod=2
Sep 17 01:32:50.137050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.137019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" event={"ID":"5e9d631b-54b3-4160-918c-8d7e8419043a","Type":"ContainerStarted","Data":"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"}
Sep 17 01:32:50.137164 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.137087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:32:50.156534 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.156478    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" podStartSLOduration=1.7523994109999999 podStartE2EDuration="8.15646208s" totalImagesPullingTime="6.404062669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:32:50.155747274 +0000 UTC m=+668.799855381" watchObservedRunningTime="2026-09-17 01:32:50.15646208 +0000 UTC m=+668.800570160"
Sep 17 01:32:50.369981 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.369957    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:50.372198 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:50.372170    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:50.457646 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.457614    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c8mf\" (UniqueName: \"kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf\") pod \"076805bd-fc74-41bf-b5c3-93426fc4201b\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") "
Sep 17 01:32:50.457828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.457696    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume\") pod \"076805bd-fc74-41bf-b5c3-93426fc4201b\" (UID: \"076805bd-fc74-41bf-b5c3-93426fc4201b\") "
Sep 17 01:32:50.457988 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.457954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "076805bd-fc74-41bf-b5c3-93426fc4201b" (UID: "076805bd-fc74-41bf-b5c3-93426fc4201b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:32:50.459598 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.459572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf" (OuterVolumeSpecName: "kube-api-access-4c8mf") pod "076805bd-fc74-41bf-b5c3-93426fc4201b" (UID: "076805bd-fc74-41bf-b5c3-93426fc4201b"). InnerVolumeSpecName "kube-api-access-4c8mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:32:50.558268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.558198    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076805bd-fc74-41bf-b5c3-93426fc4201b-extensions-socket-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:32:50.558268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:50.558224    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c8mf\" (UniqueName: \"kubernetes.io/projected/076805bd-fc74-41bf-b5c3-93426fc4201b-kube-api-access-4c8mf\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:32:51.072895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.072858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:51.143023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.142992    2573 generic.go:356] "Generic (PLEG): container finished" podID="076805bd-fc74-41bf-b5c3-93426fc4201b" containerID="a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842" exitCode=2
Sep 17 01:32:51.143401 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.143036    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:51.143401 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.143050    2573 scope.go:117] "RemoveContainer" containerID="a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842"
Sep 17 01:32:51.145351 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:51.145315    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:51.151199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.151185    2573 scope.go:117] "RemoveContainer" containerID="a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842"
Sep 17 01:32:51.151457 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:51.151441    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842\": container with ID starting with a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842 not found: ID does not exist" containerID="a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842"
Sep 17 01:32:51.151504 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.151466    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842"} err="failed to get container status \"a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842\": rpc error: code = NotFound desc = could not find container \"a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842\": container with ID starting with a2167dcb8d6af50b0c22c0f45daac640895e32d499e907691cc051de7b2c9842 not found: ID does not exist"
Sep 17 01:32:51.153098 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:51.153078    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:51.171610 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.171578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:51.797157 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:32:51.797117    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-ww7lb\" is forbidden: User \"system:node:ip-10-0-136-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-54.ec2.internal' and this object" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ww7lb"
Sep 17 01:32:51.798280 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:51.798258    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" path="/var/lib/kubelet/pods/076805bd-fc74-41bf-b5c3-93426fc4201b/volumes"
Sep 17 01:32:55.963243 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:55.963208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:56.063233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:56.063199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:32:56.164539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:32:56.164512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:00.980356 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:00.980324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:01.145169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:01.145142    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:33:02.995290 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:02.995252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:03.094151 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:03.094119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:05.426024 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:05.425987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:05.528061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:05.528024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:11.992516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:11.992485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:12.093710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:12.093677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:14.182831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.182800    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:33:14.183181 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.182989    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" podUID="5e9d631b-54b3-4160-918c-8d7e8419043a" containerName="manager" containerID="cri-o://285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531" gracePeriod=10
Sep 17 01:33:14.420441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.420416    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:33:14.527822 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.527729    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sksdn\" (UniqueName: \"kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn\") pod \"5e9d631b-54b3-4160-918c-8d7e8419043a\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") "
Sep 17 01:33:14.527952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.527861    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume\") pod \"5e9d631b-54b3-4160-918c-8d7e8419043a\" (UID: \"5e9d631b-54b3-4160-918c-8d7e8419043a\") "
Sep 17 01:33:14.528337 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.528313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e9d631b-54b3-4160-918c-8d7e8419043a" (UID: "5e9d631b-54b3-4160-918c-8d7e8419043a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:33:14.529819 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.529793    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn" (OuterVolumeSpecName: "kube-api-access-sksdn") pod "5e9d631b-54b3-4160-918c-8d7e8419043a" (UID: "5e9d631b-54b3-4160-918c-8d7e8419043a"). InnerVolumeSpecName "kube-api-access-sksdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:33:14.629267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.629237    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e9d631b-54b3-4160-918c-8d7e8419043a-extensions-socket-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:33:14.629267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:14.629263    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sksdn\" (UniqueName: \"kubernetes.io/projected/5e9d631b-54b3-4160-918c-8d7e8419043a-kube-api-access-sksdn\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:33:15.239651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.239617    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e9d631b-54b3-4160-918c-8d7e8419043a" containerID="285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531" exitCode=0
Sep 17 01:33:15.240093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.239669    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"
Sep 17 01:33:15.240093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.239694    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" event={"ID":"5e9d631b-54b3-4160-918c-8d7e8419043a","Type":"ContainerDied","Data":"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"}
Sep 17 01:33:15.240093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.239746    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2" event={"ID":"5e9d631b-54b3-4160-918c-8d7e8419043a","Type":"ContainerDied","Data":"fb353631b0d82a7cffe839407d90c83e03259a7100ef4925548d894b1239c752"}
Sep 17 01:33:15.240093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.239781    2573 scope.go:117] "RemoveContainer" containerID="285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"
Sep 17 01:33:15.250246 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.250227    2573 scope.go:117] "RemoveContainer" containerID="285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"
Sep 17 01:33:15.250545 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:33:15.250521    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531\": container with ID starting with 285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531 not found: ID does not exist" containerID="285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"
Sep 17 01:33:15.250604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.250556    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531"} err="failed to get container status \"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531\": rpc error: code = NotFound desc = could not find container \"285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531\": container with ID starting with 285c68f84362ac344cc5bbfe2d2dac82be3f80f84cef7c42072cb5a4d0d97531 not found: ID does not exist"
Sep 17 01:33:15.261944 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.261914    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:33:15.267836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.267791    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-llgs2"]
Sep 17 01:33:15.798617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:15.798584    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e9d631b-54b3-4160-918c-8d7e8419043a" path="/var/lib/kubelet/pods/5e9d631b-54b3-4160-918c-8d7e8419043a/volumes"
Sep 17 01:33:17.189907 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.189873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.290301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.290255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.502795 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.502701    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"]
Sep 17 01:33:17.503009 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.502995    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" containerName="manager"
Sep 17 01:33:17.503064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503011    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" containerName="manager"
Sep 17 01:33:17.503064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503019    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" containerName="manager"
Sep 17 01:33:17.503064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503024    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" containerName="manager"
Sep 17 01:33:17.503064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503040    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e9d631b-54b3-4160-918c-8d7e8419043a" containerName="manager"
Sep 17 01:33:17.503064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503045    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e9d631b-54b3-4160-918c-8d7e8419043a" containerName="manager"
Sep 17 01:33:17.503241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503090    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb41127-6b44-4355-a6f5-8188b5cbe67e" containerName="manager"
Sep 17 01:33:17.503241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503098    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="076805bd-fc74-41bf-b5c3-93426fc4201b" containerName="manager"
Sep 17 01:33:17.503241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.503105    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e9d631b-54b3-4160-918c-8d7e8419043a" containerName="manager"
Sep 17 01:33:17.507324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.507300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.511349 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.511331    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sl9nt\""
Sep 17 01:33:17.518285 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.518264    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"]
Sep 17 01:33:17.527266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.527243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.625489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.625459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.651711 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.651875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.651875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.651875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkfz\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-kube-api-access-lwkfz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.652045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.652045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.652045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.651963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.652045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.652000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.652045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.652035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.725987 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.725959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.753182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkfz\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-kube-api-access-lwkfz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753345    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.753818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.753813    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.754117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.754094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.755555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.755538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.755895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.755872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.763816 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.763785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.764177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.764157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkfz\" (UniqueName: \"kubernetes.io/projected/d7db02d2-f8ec-4e09-ab3d-24685d2892a6-kube-api-access-lwkfz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nld96\" (UID: \"d7db02d2-f8ec-4e09-ab3d-24685d2892a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.817231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.817205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:17.826576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.826535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:17.928585 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:17.928557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:18.094720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:18.094695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"]
Sep 17 01:33:18.096893 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:33:18.096861    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7db02d2_f8ec_4e09_ab3d_24685d2892a6.slice/crio-c7f8c62a7ebf69f49fc260487cfbb1af6328e1941d27d5cf221d6b1a1c006e7b WatchSource:0}: Error finding container c7f8c62a7ebf69f49fc260487cfbb1af6328e1941d27d5cf221d6b1a1c006e7b: Status 404 returned error can't find the container with id c7f8c62a7ebf69f49fc260487cfbb1af6328e1941d27d5cf221d6b1a1c006e7b
Sep 17 01:33:18.098731 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:18.098713    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:33:18.254925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:18.254886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" event={"ID":"d7db02d2-f8ec-4e09-ab3d-24685d2892a6","Type":"ContainerStarted","Data":"c7f8c62a7ebf69f49fc260487cfbb1af6328e1941d27d5cf221d6b1a1c006e7b"}
Sep 17 01:33:22.517295 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:22.517260    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:33:22.517570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:22.517348    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:33:22.517570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:22.517380    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:33:23.279334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:23.279295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" event={"ID":"d7db02d2-f8ec-4e09-ab3d-24685d2892a6","Type":"ContainerStarted","Data":"822010bf7041ffee06d8c14ad21dfb542fcb505da99efdaffa3fcd000301b72f"}
Sep 17 01:33:23.299074 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:23.299024    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podStartSLOduration=1.880863722 podStartE2EDuration="6.29900802s" totalImagesPullingTime="4.418144298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:33:23.297853904 +0000 UTC m=+701.941961994" watchObservedRunningTime="2026-09-17 01:33:23.29900802 +0000 UTC m=+701.943116100"
Sep 17 01:33:23.817935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:23.817907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:23.826943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:23.826909    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:24.283127 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.283088    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:24.284178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.284159    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:33:24.320851 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.320820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:24.324394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.324365    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:24.327745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.327723    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.330375 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.330347    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gkprx\""
Sep 17 01:33:24.330481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.330388    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 01:33:24.330481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.330348    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 01:33:24.330732 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.330717    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 01:33:24.337804 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.337755    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:24.419707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.419677    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:24.427674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.427620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:24.485148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.485111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:24.512094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.512007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5w9\" (UniqueName: \"kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.512229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.512164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.613033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.612998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.613173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.613045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5w9\" (UniqueName: \"kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.613648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.613627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.620618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.620587    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5w9\" (UniqueName: \"kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9\") pod \"limitador-limitador-8588749977-wzhlf\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") " pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.638539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.638520    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:24.714375 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.714313    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:33:24.718349 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.718323    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.725457 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.725434    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:33:24.749332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.749309    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:33:24.797880 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.797857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:24.816008 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.815988    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pbp\" (UniqueName: \"kubernetes.io/projected/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-kube-api-access-h9pbp\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.816115 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.816026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-config-file\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.898519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.898458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:24.906993 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.906976    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:24.909332 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:33:24.909309    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7fd4de_7a47_4965_a5c0_358b4075a7b5.slice/crio-5fe98bc14f0ef1da07cb3e58882b7078e2b5994cbef210e8d9b276574769813b WatchSource:0}: Error finding container 5fe98bc14f0ef1da07cb3e58882b7078e2b5994cbef210e8d9b276574769813b: Status 404 returned error can't find the container with id 5fe98bc14f0ef1da07cb3e58882b7078e2b5994cbef210e8d9b276574769813b
Sep 17 01:33:24.916893 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.916873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pbp\" (UniqueName: \"kubernetes.io/projected/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-kube-api-access-h9pbp\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.916990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.916911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-config-file\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.917419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.917402    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-config-file\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:24.924184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:24.924164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pbp\" (UniqueName: \"kubernetes.io/projected/2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f-kube-api-access-h9pbp\") pod \"limitador-limitador-84994f7ffc-xr2mk\" (UID: \"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:25.029169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:25.029146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:25.152604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:25.152528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:25.236886 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:25.236851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:25.288858 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:25.288799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" event={"ID":"5e7fd4de-7a47-4965-a5c0-358b4075a7b5","Type":"ContainerStarted","Data":"5fe98bc14f0ef1da07cb3e58882b7078e2b5994cbef210e8d9b276574769813b"}
Sep 17 01:33:25.294268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:25.294242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:33:25.297336 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:33:25.297311    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2871b6b0_4f01_4fc1_88b4_3756d5c1ff8f.slice/crio-e000dcff03c5cf818e2144bf5a8dc612c734d7f81e5a5508b3004c35ef2e0717 WatchSource:0}: Error finding container e000dcff03c5cf818e2144bf5a8dc612c734d7f81e5a5508b3004c35ef2e0717: Status 404 returned error can't find the container with id e000dcff03c5cf818e2144bf5a8dc612c734d7f81e5a5508b3004c35ef2e0717
Sep 17 01:33:26.294113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.294079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk" event={"ID":"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f","Type":"ContainerStarted","Data":"3807281c83d59a381a5f9eb9ca2ce3acd0ac239d51ade89ce0adcf115356358d"}
Sep 17 01:33:26.294498 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.294145    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:26.294498 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.294173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk" event={"ID":"2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f","Type":"ContainerStarted","Data":"e000dcff03c5cf818e2144bf5a8dc612c734d7f81e5a5508b3004c35ef2e0717"}
Sep 17 01:33:26.295616 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.295589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" event={"ID":"5e7fd4de-7a47-4965-a5c0-358b4075a7b5","Type":"ContainerStarted","Data":"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"}
Sep 17 01:33:26.295813 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.295794    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:26.309556 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.309519    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk" podStartSLOduration=1.4293177959999999 podStartE2EDuration="2.309506524s" totalImagesPullingTime="880.188728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:33:26.308381556 +0000 UTC m=+704.952489647" watchObservedRunningTime="2026-09-17 01:33:26.309506524 +0000 UTC m=+704.953614602"
Sep 17 01:33:26.323406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.323364    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" podStartSLOduration=1.053600902 podStartE2EDuration="2.323351514s" totalImagesPullingTime="1.269750612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:33:26.321537373 +0000 UTC m=+704.965645473" watchObservedRunningTime="2026-09-17 01:33:26.323351514 +0000 UTC m=+704.967459593"
Sep 17 01:33:26.951786 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:26.951751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:27.244578 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:27.244457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:27.344278 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:27.344247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:33.795059 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:33.795019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:33.895328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:33.895293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:37.300265 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.300191    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"
Sep 17 01:33:37.300265 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.300257    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:37.355007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.354968    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:37.355177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.355155    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" podUID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" containerName="limitador" containerID="cri-o://25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663" gracePeriod=30
Sep 17 01:33:37.890497 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.890472    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:37.912315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.912286    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q5w9\" (UniqueName: \"kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9\") pod \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") "
Sep 17 01:33:37.912315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.912319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file\") pod \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\" (UID: \"5e7fd4de-7a47-4965-a5c0-358b4075a7b5\") "
Sep 17 01:33:37.912701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.912679    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file" (OuterVolumeSpecName: "config-file") pod "5e7fd4de-7a47-4965-a5c0-358b4075a7b5" (UID: "5e7fd4de-7a47-4965-a5c0-358b4075a7b5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:33:37.914393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:37.914330    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9" (OuterVolumeSpecName: "kube-api-access-8q5w9") pod "5e7fd4de-7a47-4965-a5c0-358b4075a7b5" (UID: "5e7fd4de-7a47-4965-a5c0-358b4075a7b5"). InnerVolumeSpecName "kube-api-access-8q5w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:33:38.013654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.013608    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q5w9\" (UniqueName: \"kubernetes.io/projected/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-kube-api-access-8q5w9\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:33:38.013654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.013649    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e7fd4de-7a47-4965-a5c0-358b4075a7b5-config-file\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:33:38.350972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.350880    2573 generic.go:356] "Generic (PLEG): container finished" podID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" containerID="25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663" exitCode=0
Sep 17 01:33:38.350972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.350932    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf"
Sep 17 01:33:38.350972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.350960    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" event={"ID":"5e7fd4de-7a47-4965-a5c0-358b4075a7b5","Type":"ContainerDied","Data":"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"}
Sep 17 01:33:38.351475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.351012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wzhlf" event={"ID":"5e7fd4de-7a47-4965-a5c0-358b4075a7b5","Type":"ContainerDied","Data":"5fe98bc14f0ef1da07cb3e58882b7078e2b5994cbef210e8d9b276574769813b"}
Sep 17 01:33:38.351475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.351034    2573 scope.go:117] "RemoveContainer" containerID="25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"
Sep 17 01:33:38.360059 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.359904    2573 scope.go:117] "RemoveContainer" containerID="25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"
Sep 17 01:33:38.360183 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:33:38.360168    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663\": container with ID starting with 25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663 not found: ID does not exist" containerID="25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"
Sep 17 01:33:38.360267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.360190    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663"} err="failed to get container status \"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663\": rpc error: code = NotFound desc = could not find container \"25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663\": container with ID starting with 25a9ccf2a2133c41a423ad98e7d6deeaa294ce975eba8ae1650e631bdd134663 not found: ID does not exist"
Sep 17 01:33:38.373024 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.372997    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:38.376364 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:38.376341    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wzhlf"]
Sep 17 01:33:39.797995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:39.797962    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" path="/var/lib/kubelet/pods/5e7fd4de-7a47-4965-a5c0-358b4075a7b5/volumes"
Sep 17 01:33:40.339461 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.339428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:40.439522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.439489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:40.823239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.823203    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"]
Sep 17 01:33:40.823699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.823607    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" containerName="limitador"
Sep 17 01:33:40.823699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.823625    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" containerName="limitador"
Sep 17 01:33:40.823826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.823729    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e7fd4de-7a47-4965-a5c0-358b4075a7b5" containerName="limitador"
Sep 17 01:33:40.828268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.828247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:40.830852 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.830830    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 01:33:40.831068 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.831055    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 01:33:40.831937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.831917    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 01:33:40.831937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.831926    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-pldxl\""
Sep 17 01:33:40.834487 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.834463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"]
Sep 17 01:33:40.855720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.855697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:40.937955 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.937925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a46fff9-645f-4a05-be45-2a8dcd00b23e-data\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:40.938103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:40.937991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckr5\" (UniqueName: \"kubernetes.io/projected/6a46fff9-645f-4a05-be45-2a8dcd00b23e-kube-api-access-gckr5\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.038902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.038871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckr5\" (UniqueName: \"kubernetes.io/projected/6a46fff9-645f-4a05-be45-2a8dcd00b23e-kube-api-access-gckr5\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.039031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.038929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a46fff9-645f-4a05-be45-2a8dcd00b23e-data\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.039231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.039215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a46fff9-645f-4a05-be45-2a8dcd00b23e-data\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.046879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.046858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckr5\" (UniqueName: \"kubernetes.io/projected/6a46fff9-645f-4a05-be45-2a8dcd00b23e-kube-api-access-gckr5\") pod \"postgres-69fb4594cf-9l8qq\" (UID: \"6a46fff9-645f-4a05-be45-2a8dcd00b23e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.138994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.138966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:41.407076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:41.407003    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"]
Sep 17 01:33:41.410256 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:33:41.410229    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a46fff9_645f_4a05_be45_2a8dcd00b23e.slice/crio-6c80f1e9eed391d7d3cb9bbfbe2f13a3efad81a00a4b7ea8c8b6a3488357906b WatchSource:0}: Error finding container 6c80f1e9eed391d7d3cb9bbfbe2f13a3efad81a00a4b7ea8c8b6a3488357906b: Status 404 returned error can't find the container with id 6c80f1e9eed391d7d3cb9bbfbe2f13a3efad81a00a4b7ea8c8b6a3488357906b
Sep 17 01:33:42.373435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:42.373397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq" event={"ID":"6a46fff9-645f-4a05-be45-2a8dcd00b23e","Type":"ContainerStarted","Data":"6c80f1e9eed391d7d3cb9bbfbe2f13a3efad81a00a4b7ea8c8b6a3488357906b"}
Sep 17 01:33:46.074821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:46.074797    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 01:33:46.397105 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:46.397062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq" event={"ID":"6a46fff9-645f-4a05-be45-2a8dcd00b23e","Type":"ContainerStarted","Data":"743432d780dda7b87e1b975d61d625378913260a750f09e145186443b49bb7c6"}
Sep 17 01:33:46.397265 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:46.397137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:46.412190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:46.412144    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq" podStartSLOduration=1.7513243809999999 podStartE2EDuration="6.412130034s" totalImagesPullingTime="4.660805653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:33:46.410593117 +0000 UTC m=+725.054701217" watchObservedRunningTime="2026-09-17 01:33:46.412130034 +0000 UTC m=+725.056238112"
Sep 17 01:33:52.429507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:52.429478    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9l8qq"
Sep 17 01:33:52.734962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:52.734875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:33:53.083562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:33:53.083476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:00.346814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.346766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:00.449486 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.449457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:00.539349 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.539313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:00.543114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.543090    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:34:00.566429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.566402    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:34:00.566561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.566494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.568895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.568871    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:34:00.569017 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.568890    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:34:00.569017 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.568906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:34:00.570075 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.570059    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fwpg7\""
Sep 17 01:34:00.672387 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.672345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:00.701061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.701038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.701144 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.701067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gfr\" (UniqueName: \"kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.701182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.701137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.802100 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.802071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.802235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.802107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.802235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.802125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gfr\" (UniqueName: \"kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.804602 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.804573    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.804719 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.804609    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.809765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.809743    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gfr\" (UniqueName: \"kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr\") pod \"maas-controller-76876668bc-r8hvv\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") " pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:00.876889 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:00.876861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:01.141695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:01.141667    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:34:01.143692 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:34:01.143658    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72508f7c_c66d_403f_bd22_d9e2c890624a.slice/crio-e324208e321421b48a48e914a1686e57995e9066ea9dc0013316fec18f357ab6 WatchSource:0}: Error finding container e324208e321421b48a48e914a1686e57995e9066ea9dc0013316fec18f357ab6: Status 404 returned error can't find the container with id e324208e321421b48a48e914a1686e57995e9066ea9dc0013316fec18f357ab6
Sep 17 01:34:01.457233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:01.457199    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-r8hvv" event={"ID":"72508f7c-c66d-403f-bd22-d9e2c890624a","Type":"ContainerStarted","Data":"e324208e321421b48a48e914a1686e57995e9066ea9dc0013316fec18f357ab6"}
Sep 17 01:34:03.395862 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:03.395837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:03.469894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:03.469864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-r8hvv" event={"ID":"72508f7c-c66d-403f-bd22-d9e2c890624a","Type":"ContainerStarted","Data":"6fb60ef4b6db39ccf2bf513259518c38a92ca9511b9cc09ee0595bae2fdc95d3"}
Sep 17 01:34:03.470018 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:03.469938    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:03.489800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:03.489743    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76876668bc-r8hvv" podStartSLOduration=1.263662739 podStartE2EDuration="3.489729979s" totalImagesPullingTime="2.22606724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:34:03.488462822 +0000 UTC m=+742.132570920" watchObservedRunningTime="2026-09-17 01:34:03.489729979 +0000 UTC m=+742.133838302"
Sep 17 01:34:03.493177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:03.493155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:14.476137 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:14.476100    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:34:34.988005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:34.987955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:35.092529 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:35.092489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:36.412346 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:36.412312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:36.483531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:36.483498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:36.545103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:36.545069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:36.948895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:36.948864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:37.047655 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:37.047584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:37.160317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:37.160280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:34:46.657814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.657759    2573 generic.go:356] "Generic (PLEG): container finished" podID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerID="822010bf7041ffee06d8c14ad21dfb542fcb505da99efdaffa3fcd000301b72f" exitCode=0
Sep 17 01:34:46.658205 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.657835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" event={"ID":"d7db02d2-f8ec-4e09-ab3d-24685d2892a6","Type":"ContainerDied","Data":"822010bf7041ffee06d8c14ad21dfb542fcb505da99efdaffa3fcd000301b72f"}
Sep 17 01:34:46.658246 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.658225    2573 scope.go:117] "RemoveContainer" containerID="822010bf7041ffee06d8c14ad21dfb542fcb505da99efdaffa3fcd000301b72f"
Sep 17 01:34:46.659252 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.659214    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:34:46.659324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.659304    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:34:46.659365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.659336    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:34:46.841566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.841526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:46.940858 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:46.940721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:47.664355 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:47.664322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" event={"ID":"d7db02d2-f8ec-4e09-ab3d-24685d2892a6","Type":"ContainerStarted","Data":"d1648391674be1fed1839fe99b2fdde70e98c327c3815a54ba9ea29eb6328649"}
Sep 17 01:34:47.817819 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:47.817787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:34:47.817991 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:47.817933    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:47.817991 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:47.817975    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:48.818286 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:48.818214    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:48.819338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:48.819262    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:49.818596 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:49.818549    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:49.819102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:49.818628    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:50.818160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:50.818120    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:50.818450 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:50.818417    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:51.817820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:51.817760    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:51.818421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:51.818387    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:52.818088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:52.818051    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nld96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 17 01:34:52.818678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:52.818637    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96" podUID="d7db02d2-f8ec-4e09-ab3d-24685d2892a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 17 01:34:53.821714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:53.821684    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:34:53.822134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:53.821942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:34:53.822557 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:53.822539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96"
Sep 17 01:34:54.006091 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:54.006057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:34:54.494367 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:34:54.494329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:35:08.858162 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.858080    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"]
Sep 17 01:35:08.861565 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.861542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.865223 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.865203    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6kzrq\""
Sep 17 01:35:08.865333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.865218    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 01:35:08.865333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.865226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 17 01:35:08.865333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.865227    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 01:35:08.871890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.871866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"]
Sep 17 01:35:08.894234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.894202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:08.948476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948439    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.948695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.948695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsq25\" (UniqueName: \"kubernetes.io/projected/aab0b985-d892-4e4c-a673-76537bf231f3-kube-api-access-lsq25\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.948794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.948794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:08.948794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:08.948765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab0b985-d892-4e4c-a673-76537bf231f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049560 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049560 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsq25\" (UniqueName: \"kubernetes.io/projected/aab0b985-d892-4e4c-a673-76537bf231f3-kube-api-access-lsq25\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.049954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.049821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab0b985-d892-4e4c-a673-76537bf231f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.050024 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.050001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.050062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.050048    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.050130 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.050108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.052042 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.052023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab0b985-d892-4e4c-a673-76537bf231f3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.052232 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.052216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab0b985-d892-4e4c-a673-76537bf231f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.056540 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.056523    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsq25\" (UniqueName: \"kubernetes.io/projected/aab0b985-d892-4e4c-a673-76537bf231f3-kube-api-access-lsq25\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vxzwm\" (UID: \"aab0b985-d892-4e4c-a673-76537bf231f3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.172807 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.172706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:09.441786 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.441739    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"]
Sep 17 01:35:09.443983 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:35:09.443951    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab0b985_d892_4e4c_a673_76537bf231f3.slice/crio-43e812f3b30bdcac610102afb53bbd8b3a4772b853ac8929ecd6662dd3551caa WatchSource:0}: Error finding container 43e812f3b30bdcac610102afb53bbd8b3a4772b853ac8929ecd6662dd3551caa: Status 404 returned error can't find the container with id 43e812f3b30bdcac610102afb53bbd8b3a4772b853ac8929ecd6662dd3551caa
Sep 17 01:35:09.483395 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.483363    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:35:09.759122 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:09.759034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm" event={"ID":"aab0b985-d892-4e4c-a673-76537bf231f3","Type":"ContainerStarted","Data":"43e812f3b30bdcac610102afb53bbd8b3a4772b853ac8929ecd6662dd3551caa"}
Sep 17 01:35:10.764150 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:10.764114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm" event={"ID":"aab0b985-d892-4e4c-a673-76537bf231f3","Type":"ContainerStarted","Data":"9ac0f7ec93f624bba63308f541465da443800157064a0b18aab2968181d1ab98"}
Sep 17 01:35:10.781368 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:10.781319    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm" podStartSLOduration=1.610311463 podStartE2EDuration="2.781305073s" totalImagesPullingTime="1.17099361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:35:10.780368929 +0000 UTC m=+809.424477021" watchObservedRunningTime="2026-09-17 01:35:10.781305073 +0000 UTC m=+809.425413142"
Sep 17 01:35:15.284808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:15.284712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:16.268725 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:16.268686    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:35:19.173175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:19.173129    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:19.173563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:19.173236    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:19.185746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:19.185713    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:19.811459 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:19.811428    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vxzwm"
Sep 17 01:35:36.090967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:36.090931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:36.137831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:36.137804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:39.363417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.363385    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"]
Sep 17 01:35:39.367162 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.367137    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.369576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.369549    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 01:35:39.374536 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.374510    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"]
Sep 17 01:35:39.386688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.386837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.386837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.386939 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.386939 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.387006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.386980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnb9b\" (UniqueName: \"kubernetes.io/projected/9c6d5903-a4ab-4390-92d4-ff06e5b48481-kube-api-access-rnb9b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.460176 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.460145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:39.487340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnb9b\" (UniqueName: \"kubernetes.io/projected/9c6d5903-a4ab-4390-92d4-ff06e5b48481-kube-api-access-rnb9b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487376    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.487915 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.487848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.488039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.488006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.489747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.489722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6d5903-a4ab-4390-92d4-ff06e5b48481-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.490122 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.490101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6d5903-a4ab-4390-92d4-ff06e5b48481-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.499990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.499971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnb9b\" (UniqueName: \"kubernetes.io/projected/9c6d5903-a4ab-4390-92d4-ff06e5b48481-kube-api-access-rnb9b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rph8k\" (UID: \"9c6d5903-a4ab-4390-92d4-ff06e5b48481\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.679249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.679150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:39.947239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:39.947212    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"]
Sep 17 01:35:39.949704 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:35:39.949680    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6d5903_a4ab_4390_92d4_ff06e5b48481.slice/crio-9466067b4d39b5b53fa9ddfec8779f59875ca691b0d5b8c9ef4bd03c87ea10ee WatchSource:0}: Error finding container 9466067b4d39b5b53fa9ddfec8779f59875ca691b0d5b8c9ef4bd03c87ea10ee: Status 404 returned error can't find the container with id 9466067b4d39b5b53fa9ddfec8779f59875ca691b0d5b8c9ef4bd03c87ea10ee
Sep 17 01:35:40.236420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:40.236344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:40.571887 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:40.571800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:35:40.883016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:40.882979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k" event={"ID":"9c6d5903-a4ab-4390-92d4-ff06e5b48481","Type":"ContainerStarted","Data":"2c6df6e5d9e7ab2b00a00f4e8a16e78ce40c99b70efc5fe4d10b558106412eff"}
Sep 17 01:35:40.883177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:40.883036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k" event={"ID":"9c6d5903-a4ab-4390-92d4-ff06e5b48481","Type":"ContainerStarted","Data":"9466067b4d39b5b53fa9ddfec8779f59875ca691b0d5b8c9ef4bd03c87ea10ee"}
Sep 17 01:35:40.899518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:40.899470    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k" podStartSLOduration=1.7194867550000001 podStartE2EDuration="1.899455691s" totalImagesPullingTime="179.968936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:35:40.898415708 +0000 UTC m=+839.542523809" watchObservedRunningTime="2026-09-17 01:35:40.899455691 +0000 UTC m=+839.543563811"
Sep 17 01:35:41.850754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:41.850723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:49.679928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:49.679893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:49.680397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:49.680017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:49.692161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:49.692137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:49.930190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:49.930105    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rph8k"
Sep 17 01:35:52.899432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:52.899396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:54.172593 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:54.172557    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:35:59.361885 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.361847    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"]
Sep 17 01:35:59.366563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.366539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.368910 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.368883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 17 01:35:59.374232 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.373943    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"]
Sep 17 01:35:59.450555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.450721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.450721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c32f3ee2-f985-4638-81bc-efad92fd7de4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.450721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zzc\" (UniqueName: \"kubernetes.io/projected/c32f3ee2-f985-4638-81bc-efad92fd7de4-kube-api-access-l6zzc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.450923 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.450923 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.450858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.458906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.458869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:35:59.551620 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.551563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.551813 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.551748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c32f3ee2-f985-4638-81bc-efad92fd7de4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.551890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.551834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zzc\" (UniqueName: \"kubernetes.io/projected/c32f3ee2-f985-4638-81bc-efad92fd7de4-kube-api-access-l6zzc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.551947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.551898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.552073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.551973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.552073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.552028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.552449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.552419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.552630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.552524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.552630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.552622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.554474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.554453    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c32f3ee2-f985-4638-81bc-efad92fd7de4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.554569 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.554459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c32f3ee2-f985-4638-81bc-efad92fd7de4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.559191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.559167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zzc\" (UniqueName: \"kubernetes.io/projected/c32f3ee2-f985-4638-81bc-efad92fd7de4-kube-api-access-l6zzc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zdf8h\" (UID: \"c32f3ee2-f985-4638-81bc-efad92fd7de4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.677799 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.677710    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:35:59.950428 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.950403    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"]
Sep 17 01:35:59.952817 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:35:59.952790    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32f3ee2_f985_4638_81bc_efad92fd7de4.slice/crio-1d5f23f56edabf86d8518b7ccd7f68447857f3ea32c4c33a9b5020bfbaf73ded WatchSource:0}: Error finding container 1d5f23f56edabf86d8518b7ccd7f68447857f3ea32c4c33a9b5020bfbaf73ded: Status 404 returned error can't find the container with id 1d5f23f56edabf86d8518b7ccd7f68447857f3ea32c4c33a9b5020bfbaf73ded
Sep 17 01:35:59.964763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:35:59.964735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h" event={"ID":"c32f3ee2-f985-4638-81bc-efad92fd7de4","Type":"ContainerStarted","Data":"1d5f23f56edabf86d8518b7ccd7f68447857f3ea32c4c33a9b5020bfbaf73ded"}
Sep 17 01:36:00.972284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:00.972246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h" event={"ID":"c32f3ee2-f985-4638-81bc-efad92fd7de4","Type":"ContainerStarted","Data":"edc000d5d2619ebafce0e9c8bbe5beccbbca4b2a99081e3d2bc2fbafa5b39a53"}
Sep 17 01:36:00.989129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:00.989082    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h" podStartSLOduration=1.803146242 podStartE2EDuration="1.989065563s" totalImagesPullingTime="185.919321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:36:00.987636696 +0000 UTC m=+859.631744788" watchObservedRunningTime="2026-09-17 01:36:00.989065563 +0000 UTC m=+859.633173642"
Sep 17 01:36:01.269360 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:01.269279    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:36:03.456810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:03.456743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:36:09.576980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:09.576942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:36:09.678672 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:09.678636    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:36:09.678862 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:09.678713    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:36:09.691514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:09.691493    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:36:10.027187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:10.027158    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zdf8h"
Sep 17 01:36:19.018574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:19.018538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:36:56.272447 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:36:56.272369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:33.062701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.062659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:33.239963 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.239932    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:37:33.240182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.240157    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76876668bc-r8hvv" podUID="72508f7c-c66d-403f-bd22-d9e2c890624a" containerName="manager" containerID="cri-o://6fb60ef4b6db39ccf2bf513259518c38a92ca9511b9cc09ee0595bae2fdc95d3" gracePeriod=30
Sep 17 01:37:33.283224 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.283194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:33.372166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.372134    2573 generic.go:356] "Generic (PLEG): container finished" podID="72508f7c-c66d-403f-bd22-d9e2c890624a" containerID="6fb60ef4b6db39ccf2bf513259518c38a92ca9511b9cc09ee0595bae2fdc95d3" exitCode=0
Sep 17 01:37:33.372315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.372208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-r8hvv" event={"ID":"72508f7c-c66d-403f-bd22-d9e2c890624a","Type":"ContainerDied","Data":"6fb60ef4b6db39ccf2bf513259518c38a92ca9511b9cc09ee0595bae2fdc95d3"}
Sep 17 01:37:33.471378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.471357    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:37:33.518559 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.518530    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7gfr\" (UniqueName: \"kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr\") pod \"72508f7c-c66d-403f-bd22-d9e2c890624a\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") "
Sep 17 01:37:33.518714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.518578    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert\") pod \"72508f7c-c66d-403f-bd22-d9e2c890624a\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") "
Sep 17 01:37:33.518714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.518625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs\") pod \"72508f7c-c66d-403f-bd22-d9e2c890624a\" (UID: \"72508f7c-c66d-403f-bd22-d9e2c890624a\") "
Sep 17 01:37:33.520879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.520849    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "72508f7c-c66d-403f-bd22-d9e2c890624a" (UID: "72508f7c-c66d-403f-bd22-d9e2c890624a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:37:33.520986 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.520882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr" (OuterVolumeSpecName: "kube-api-access-g7gfr") pod "72508f7c-c66d-403f-bd22-d9e2c890624a" (UID: "72508f7c-c66d-403f-bd22-d9e2c890624a"). InnerVolumeSpecName "kube-api-access-g7gfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:37:33.521052 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.521018    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "72508f7c-c66d-403f-bd22-d9e2c890624a" (UID: "72508f7c-c66d-403f-bd22-d9e2c890624a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:37:33.597256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.597184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:33.619330 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.619304    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-webhook-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:37:33.619330 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.619332    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72508f7c-c66d-403f-bd22-d9e2c890624a-metrics-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:37:33.619481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:33.619343    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7gfr\" (UniqueName: \"kubernetes.io/projected/72508f7c-c66d-403f-bd22-d9e2c890624a-kube-api-access-g7gfr\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:37:34.250841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.250801    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:37:34.251220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.251149    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72508f7c-c66d-403f-bd22-d9e2c890624a" containerName="manager"
Sep 17 01:37:34.251220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.251164    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="72508f7c-c66d-403f-bd22-d9e2c890624a" containerName="manager"
Sep 17 01:37:34.251291 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.251244    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="72508f7c-c66d-403f-bd22-d9e2c890624a" containerName="manager"
Sep 17 01:37:34.254259 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.254236    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.263123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.263093    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:37:34.324251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.324224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rb6g\" (UniqueName: \"kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.324382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.324277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.324382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.324327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.378035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.378003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-r8hvv" event={"ID":"72508f7c-c66d-403f-bd22-d9e2c890624a","Type":"ContainerDied","Data":"e324208e321421b48a48e914a1686e57995e9066ea9dc0013316fec18f357ab6"}
Sep 17 01:37:34.378121 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.378059    2573 scope.go:117] "RemoveContainer" containerID="6fb60ef4b6db39ccf2bf513259518c38a92ca9511b9cc09ee0595bae2fdc95d3"
Sep 17 01:37:34.378121 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.378018    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-r8hvv"
Sep 17 01:37:34.395448 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.395421    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:37:34.397051 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.397028    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76876668bc-r8hvv"]
Sep 17 01:37:34.425539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.425518    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.425623 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.425544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.425755 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.425738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rb6g\" (UniqueName: \"kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.427971 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.427945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.428046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.427999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.432982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.432963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rb6g\" (UniqueName: \"kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g\") pod \"maas-controller-76876668bc-n7rxl\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") " pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.565078 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.565013    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:34.833675 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:34.833652    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:37:34.836265 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:37:34.836237    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1e1ea5_07ee_43b4_a201_8b41a7b77535.slice/crio-8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e WatchSource:0}: Error finding container 8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e: Status 404 returned error can't find the container with id 8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e
Sep 17 01:37:35.385963 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:35.385928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-n7rxl" event={"ID":"0f1e1ea5-07ee-43b4-a201-8b41a7b77535","Type":"ContainerStarted","Data":"cfa2ebc2572c05194d83044dd4e598123a330a7fb26653a181cccf7aa32e5c46"}
Sep 17 01:37:35.386320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:35.385979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-n7rxl" event={"ID":"0f1e1ea5-07ee-43b4-a201-8b41a7b77535","Type":"ContainerStarted","Data":"8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e"}
Sep 17 01:37:35.386320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:35.386061    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:35.417294 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:35.417248    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76876668bc-n7rxl" podStartSLOduration=1.04268094 podStartE2EDuration="1.417230725s" totalImagesPullingTime="374.549785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:35.415585283 +0000 UTC m=+954.059693372" watchObservedRunningTime="2026-09-17 01:37:35.417230725 +0000 UTC m=+954.061338819"
Sep 17 01:37:35.798331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:35.798297    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72508f7c-c66d-403f-bd22-d9e2c890624a" path="/var/lib/kubelet/pods/72508f7c-c66d-403f-bd22-d9e2c890624a/volumes"
Sep 17 01:37:46.391767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:46.391733    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:37:50.301212 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:50.301176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:50.396723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:50.396691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:58.117007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:37:58.116963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:15.317049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.316968    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:38:15.317555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.317227    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76876668bc-n7rxl" podUID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" containerName="manager" containerID="cri-o://cfa2ebc2572c05194d83044dd4e598123a330a7fb26653a181cccf7aa32e5c46" gracePeriod=30
Sep 17 01:38:15.554442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.554411    2573 generic.go:356] "Generic (PLEG): container finished" podID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" containerID="cfa2ebc2572c05194d83044dd4e598123a330a7fb26653a181cccf7aa32e5c46" exitCode=0
Sep 17 01:38:15.554579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.554463    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-n7rxl" event={"ID":"0f1e1ea5-07ee-43b4-a201-8b41a7b77535","Type":"ContainerDied","Data":"cfa2ebc2572c05194d83044dd4e598123a330a7fb26653a181cccf7aa32e5c46"}
Sep 17 01:38:15.554579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.554513    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-n7rxl" event={"ID":"0f1e1ea5-07ee-43b4-a201-8b41a7b77535","Type":"ContainerDied","Data":"8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e"}
Sep 17 01:38:15.554579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.554538    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f61bc045f0b1dcbdffc5d7018f531faea13a11ef5263270601b13b9b372030e"
Sep 17 01:38:15.561713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.561691    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:38:15.656234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.656204    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs\") pod \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") "
Sep 17 01:38:15.656410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.656248    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rb6g\" (UniqueName: \"kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g\") pod \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") "
Sep 17 01:38:15.656410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.656287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert\") pod \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\" (UID: \"0f1e1ea5-07ee-43b4-a201-8b41a7b77535\") "
Sep 17 01:38:15.658249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.658212    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g" (OuterVolumeSpecName: "kube-api-access-4rb6g") pod "0f1e1ea5-07ee-43b4-a201-8b41a7b77535" (UID: "0f1e1ea5-07ee-43b4-a201-8b41a7b77535"). InnerVolumeSpecName "kube-api-access-4rb6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:38:15.658249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.658240    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0f1e1ea5-07ee-43b4-a201-8b41a7b77535" (UID: "0f1e1ea5-07ee-43b4-a201-8b41a7b77535"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:38:15.658408 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.658264    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f1e1ea5-07ee-43b4-a201-8b41a7b77535" (UID: "0f1e1ea5-07ee-43b4-a201-8b41a7b77535"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:38:15.757292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.757261    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-metrics-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:15.757292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.757291    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rb6g\" (UniqueName: \"kubernetes.io/projected/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-kube-api-access-4rb6g\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:15.757451 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:15.757305    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f1e1ea5-07ee-43b4-a201-8b41a7b77535-webhook-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:16.558382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:16.558342    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-n7rxl"
Sep 17 01:38:16.574311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:16.574283    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:38:16.575806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:16.575766    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76876668bc-n7rxl"]
Sep 17 01:38:17.798344 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:17.798300    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" path="/var/lib/kubelet/pods/0f1e1ea5-07ee-43b4-a201-8b41a7b77535/volumes"
Sep 17 01:38:20.331020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:20.330979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:20.660633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:20.660598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:21.093055 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.092975    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:21.093287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.093275    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" containerName="manager"
Sep 17 01:38:21.093330 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.093288    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" containerName="manager"
Sep 17 01:38:21.093363 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.093343    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f1e1ea5-07ee-43b4-a201-8b41a7b77535" containerName="manager"
Sep 17 01:38:21.096392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.096370    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.099071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.099049    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:38:21.100026 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.100004    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:38:21.100124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.100051    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fwpg7\""
Sep 17 01:38:21.100124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.100057    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:38:21.105943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.105924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:21.201333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.201304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.201454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.201361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.201454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.201421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8b2\" (UniqueName: \"kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.301837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.301798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.301837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.301847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8b2\" (UniqueName: \"kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.302044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.301893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.304200 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.304179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.304308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.304290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.309674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.309651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8b2\" (UniqueName: \"kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2\") pod \"maas-controller-76876668bc-56m6q\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") " pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.406829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.406799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:21.674665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.674638    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:21.677488 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:38:21.677455    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862d47a9_66c9_4087_bf54_dd092e637d58.slice/crio-52ff7dd9f69c6e64cc8b3a6bb1aa32f55b2ede58c2425d9c25a8c8a64a265638 WatchSource:0}: Error finding container 52ff7dd9f69c6e64cc8b3a6bb1aa32f55b2ede58c2425d9c25a8c8a64a265638: Status 404 returned error can't find the container with id 52ff7dd9f69c6e64cc8b3a6bb1aa32f55b2ede58c2425d9c25a8c8a64a265638
Sep 17 01:38:21.679184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:21.679165    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:38:22.587430 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:22.587395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-56m6q" event={"ID":"862d47a9-66c9-4087-bf54-dd092e637d58","Type":"ContainerStarted","Data":"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"}
Sep 17 01:38:22.587823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:22.587450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-56m6q" event={"ID":"862d47a9-66c9-4087-bf54-dd092e637d58","Type":"ContainerStarted","Data":"52ff7dd9f69c6e64cc8b3a6bb1aa32f55b2ede58c2425d9c25a8c8a64a265638"}
Sep 17 01:38:22.587823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:22.587492    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:22.603323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:22.602885    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76876668bc-56m6q" podStartSLOduration=1.254462126 podStartE2EDuration="1.602869731s" totalImagesPullingTime="348.407605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:22.602601596 +0000 UTC m=+1001.246709708" watchObservedRunningTime="2026-09-17 01:38:22.602869731 +0000 UTC m=+1001.246977810"
Sep 17 01:38:33.594413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:33.594379    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:33.996940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:33.996907    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:38:34.002421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.002377    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.008699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.008673    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:38:34.097088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.097055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.097218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.097148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.097218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.097171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4cm2\" (UniqueName: \"kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.197860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.197820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.197860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.197866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cm2\" (UniqueName: \"kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.198076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.197923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.200400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.200378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.200400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.200387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.206514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.206493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cm2\" (UniqueName: \"kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2\") pod \"maas-controller-749bfb5bfc-svr62\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") " pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.314722 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.314652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:34.583432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.583408    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:38:34.585862 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:38:34.585837    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75401b97_0e32_40df_9ec4_580910446846.slice/crio-40ee25010092aafc8acd9a44fc03692a005f3f114a95058709419490ace24447 WatchSource:0}: Error finding container 40ee25010092aafc8acd9a44fc03692a005f3f114a95058709419490ace24447: Status 404 returned error can't find the container with id 40ee25010092aafc8acd9a44fc03692a005f3f114a95058709419490ace24447
Sep 17 01:38:34.640666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:34.640636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-svr62" event={"ID":"75401b97-0e32-40df-9ec4-580910446846","Type":"ContainerStarted","Data":"40ee25010092aafc8acd9a44fc03692a005f3f114a95058709419490ace24447"}
Sep 17 01:38:35.647097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:35.647057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-svr62" event={"ID":"75401b97-0e32-40df-9ec4-580910446846","Type":"ContainerStarted","Data":"c8c0b689e3da4e40643b9826a3da05d63e9ccc26da999e06c76e553f118a5e2b"}
Sep 17 01:38:35.647455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:35.647174    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:35.661984 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:35.661930    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-749bfb5bfc-svr62" podStartSLOduration=2.240754163 podStartE2EDuration="2.661909857s" totalImagesPullingTime="421.155694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:35.661169802 +0000 UTC m=+1014.305277893" watchObservedRunningTime="2026-09-17 01:38:35.661909857 +0000 UTC m=+1014.306017941"
Sep 17 01:38:46.653956 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.653919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:38:46.694543 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.694505    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:46.694745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.694721    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76876668bc-56m6q" podUID="862d47a9-66c9-4087-bf54-dd092e637d58" containerName="manager" containerID="cri-o://fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0" gracePeriod=30
Sep 17 01:38:46.934895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.934868    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:46.986007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.985978    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert\") pod \"862d47a9-66c9-4087-bf54-dd092e637d58\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") "
Sep 17 01:38:46.986151 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.986045    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs\") pod \"862d47a9-66c9-4087-bf54-dd092e637d58\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") "
Sep 17 01:38:46.986151 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.986072    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp8b2\" (UniqueName: \"kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2\") pod \"862d47a9-66c9-4087-bf54-dd092e637d58\" (UID: \"862d47a9-66c9-4087-bf54-dd092e637d58\") "
Sep 17 01:38:46.988053 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.988019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "862d47a9-66c9-4087-bf54-dd092e637d58" (UID: "862d47a9-66c9-4087-bf54-dd092e637d58"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:38:46.988155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.988122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2" (OuterVolumeSpecName: "kube-api-access-tp8b2") pod "862d47a9-66c9-4087-bf54-dd092e637d58" (UID: "862d47a9-66c9-4087-bf54-dd092e637d58"). InnerVolumeSpecName "kube-api-access-tp8b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:38:46.988229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:46.988155    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "862d47a9-66c9-4087-bf54-dd092e637d58" (UID: "862d47a9-66c9-4087-bf54-dd092e637d58"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:38:47.086973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.086931    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-webhook-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:47.086973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.086968    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/862d47a9-66c9-4087-bf54-dd092e637d58-metrics-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:47.086973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.086977    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8b2\" (UniqueName: \"kubernetes.io/projected/862d47a9-66c9-4087-bf54-dd092e637d58-kube-api-access-tp8b2\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:38:47.626432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.626389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:47.706795 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.706744    2573 generic.go:356] "Generic (PLEG): container finished" podID="862d47a9-66c9-4087-bf54-dd092e637d58" containerID="fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0" exitCode=0
Sep 17 01:38:47.706795 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.706792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-56m6q" event={"ID":"862d47a9-66c9-4087-bf54-dd092e637d58","Type":"ContainerDied","Data":"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"}
Sep 17 01:38:47.707301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.706813    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76876668bc-56m6q"
Sep 17 01:38:47.707301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.706843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76876668bc-56m6q" event={"ID":"862d47a9-66c9-4087-bf54-dd092e637d58","Type":"ContainerDied","Data":"52ff7dd9f69c6e64cc8b3a6bb1aa32f55b2ede58c2425d9c25a8c8a64a265638"}
Sep 17 01:38:47.707301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.706866    2573 scope.go:117] "RemoveContainer" containerID="fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"
Sep 17 01:38:47.715378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.715363    2573 scope.go:117] "RemoveContainer" containerID="fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"
Sep 17 01:38:47.715665 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:38:47.715645    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0\": container with ID starting with fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0 not found: ID does not exist" containerID="fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"
Sep 17 01:38:47.715722 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.715673    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0"} err="failed to get container status \"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0\": rpc error: code = NotFound desc = could not find container \"fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0\": container with ID starting with fd4a3da148af79335613ba01e53af1c904ff5ce90e7f8f26caf2845d435346f0 not found: ID does not exist"
Sep 17 01:38:47.727058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.727029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:47.727307 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.727289    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:47.730765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.730744    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76876668bc-56m6q"]
Sep 17 01:38:47.797973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:47.797949    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="862d47a9-66c9-4087-bf54-dd092e637d58" path="/var/lib/kubelet/pods/862d47a9-66c9-4087-bf54-dd092e637d58/volumes"
Sep 17 01:38:48.711762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:48.711725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:38:48.812745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:38:48.812668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.334445 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.334411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.433542 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.433511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.635322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.635294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.663458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.663414    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:39:04.663914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.663898    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="862d47a9-66c9-4087-bf54-dd092e637d58" containerName="manager"
Sep 17 01:39:04.663970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.663919    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="862d47a9-66c9-4087-bf54-dd092e637d58" containerName="manager"
Sep 17 01:39:04.664057 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.664045    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="862d47a9-66c9-4087-bf54-dd092e637d58" containerName="manager"
Sep 17 01:39:04.667316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.667295    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.670978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.670957    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-8be734-openshift-default-dockercfg-nh649\""
Sep 17 01:39:04.693462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.693439    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:39:04.726792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.726749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.726914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.726855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.726978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.726926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.726985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.727032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.727089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.727113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zvs\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.727154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.727249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.727184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.743123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.743097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.827707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.827902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.827902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zvs\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.827902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.827902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.827902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.827956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828171 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.828732 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.828710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.830312 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.830287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.830514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.830495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.839678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.839653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.840015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.839993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zvs\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs\") pod \"e2e-worker-w0-8be734-openshift-default-77769678-ppnbx\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") " pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:04.850985 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.850961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.966492 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.966411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:04.977542 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:04.977500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:05.071417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.071378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:05.225233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.225157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:05.252983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.252953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:39:05.256571 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:05.256541    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b3758c_5438_4860_bbb9_36584dab3207.slice/crio-0aec528d39fa26f83db3633b7167bd86cef4e5af60f8d2c24afdb56a6c02d9b3 WatchSource:0}: Error finding container 0aec528d39fa26f83db3633b7167bd86cef4e5af60f8d2c24afdb56a6c02d9b3: Status 404 returned error can't find the container with id 0aec528d39fa26f83db3633b7167bd86cef4e5af60f8d2c24afdb56a6c02d9b3
Sep 17 01:39:05.259207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.259180    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:05.259273 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.259240    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:05.259273 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.259267    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:05.658400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.658352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:05.754790 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.754748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:05.786345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.786308    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerStarted","Data":"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"}
Sep 17 01:39:05.786522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.786367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerStarted","Data":"0aec528d39fa26f83db3633b7167bd86cef4e5af60f8d2c24afdb56a6c02d9b3"}
Sep 17 01:39:05.812433 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.812377    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podStartSLOduration=1.8123610399999999 podStartE2EDuration="1.81236104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:05.811202823 +0000 UTC m=+1044.455310920" watchObservedRunningTime="2026-09-17 01:39:05.81236104 +0000 UTC m=+1044.456469119"
Sep 17 01:39:05.978512 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:05.978421    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:06.079420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:06.079386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:06.983256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:06.983225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:07.797783 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:07.797739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:07.797928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:07.797841    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:08.900249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:08.900196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:08.969718 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:08.969665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:09.097553 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:09.097519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:09.199854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:09.199766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:09.297729 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:09.297690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:10.100564 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:10.100530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:10.203896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:10.203859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:10.557983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:10.557952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:10.656169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:10.656133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.097554 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.097524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.160652 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.160620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.376315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.376285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.590374 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.590333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.686207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.686122    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:39:11.686376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.686225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:11.689446 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.689422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.691703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.691686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-cc98e0-dockercfg-4h6nl\""
Sep 17 01:39:11.691879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.691863    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-cc98e0\""
Sep 17 01:39:11.698894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.698873    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:39:11.793111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.793070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt4fw\" (UniqueName: \"kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.793404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.793373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.894074 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.894039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.894261 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.894185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4fw\" (UniqueName: \"kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.894845 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.894825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.902433 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.902412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4fw\" (UniqueName: \"kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw\") pod \"payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:11.992909 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:11.992827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.000313 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.000291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:12.055976 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.055645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.278400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.278371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:39:12.280923 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:12.280894    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a003913_5644_4f65_b955_5e0cd72faddd.slice/crio-873aabc0b7216b999827749f65cb2f073c3e7010e82a24f4e60211c0e18ed7a0 WatchSource:0}: Error finding container 873aabc0b7216b999827749f65cb2f073c3e7010e82a24f4e60211c0e18ed7a0: Status 404 returned error can't find the container with id 873aabc0b7216b999827749f65cb2f073c3e7010e82a24f4e60211c0e18ed7a0
Sep 17 01:39:12.452065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.452034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.539516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.539431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.585787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.585749    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:39:12.590052 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.590036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.592345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.592325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d8d689-dockercfg-5qrb4\""
Sep 17 01:39:12.592471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.592359    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d8d689\""
Sep 17 01:39:12.598309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.598288    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:39:12.612997 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.612961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.701738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.701701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxfxc\" (UniqueName: \"kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.701921 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.701757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.803274 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.803188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxfxc\" (UniqueName: \"kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.803274 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.803241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.803970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.803947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.810706 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.810673    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxfxc\" (UniqueName: \"kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc\") pod \"payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:12.819166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.819128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" event={"ID":"3a003913-5644-4f65-b955-5e0cd72faddd","Type":"ContainerStarted","Data":"873aabc0b7216b999827749f65cb2f073c3e7010e82a24f4e60211c0e18ed7a0"}
Sep 17 01:39:12.878539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.878508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:12.901473 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:12.901447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:13.179875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.179837    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:39:13.182951 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:13.182914    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5be3e4_7478_4416_86db_7b46fa3dfaea.slice/crio-c869b61dccc22ad9aa6b177cc1ab542063423c4297f1ec20cb0ed0dcaeb4cc03 WatchSource:0}: Error finding container c869b61dccc22ad9aa6b177cc1ab542063423c4297f1ec20cb0ed0dcaeb4cc03: Status 404 returned error can't find the container with id c869b61dccc22ad9aa6b177cc1ab542063423c4297f1ec20cb0ed0dcaeb4cc03
Sep 17 01:39:13.338314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.338288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:13.438816 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.438717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:13.559869 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.559823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:13.665945 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.665915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:13.812800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.810475    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:39:13.815517 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.815488    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.818190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.818166    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4889635f-openshift-default-dockercfg-tjdb5\""
Sep 17 01:39:13.825443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.825408    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:39:13.833979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.833952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" event={"ID":"9b5be3e4-7478-4416-86db-7b46fa3dfaea","Type":"ContainerStarted","Data":"c869b61dccc22ad9aa6b177cc1ab542063423c4297f1ec20cb0ed0dcaeb4cc03"}
Sep 17 01:39:13.835720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.835697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" event={"ID":"3a003913-5644-4f65-b955-5e0cd72faddd","Type":"ContainerStarted","Data":"5b23559b33abe90468761fcac1ccfd11b3d1a458649acee7dde53c834f249154"}
Sep 17 01:39:13.835871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.835814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:13.843335 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.843310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:13.858449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.858397    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" podStartSLOduration=1.4844553010000001 podStartE2EDuration="2.858380012s" totalImagesPullingTime="1.373924711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:13.857493787 +0000 UTC m=+1052.501601883" watchObservedRunningTime="2026-09-17 01:39:13.858380012 +0000 UTC m=+1052.502488087"
Sep 17 01:39:13.913522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913757 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913757 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913757 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrjx\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913898 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913898 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.913977 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.913928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:13.914052 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:13.914034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.014884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.014884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.014884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.014980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrjx\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015513 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.015897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.015766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.016189 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.016166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.017998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.017977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.018178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.018153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.025678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.025646    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:14.026823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.026759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrjx\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.027331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.027309    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token\") pod \"e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") " pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.130485 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.130455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:14.415262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.415135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:39:14.417928 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:14.417881    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c58577_e504_48e1_8b42_47cd3ffbab67.slice/crio-461adbbb70a41cc65d91971e9d2f0e51394341e89252fae8642683e27f277c37 WatchSource:0}: Error finding container 461adbbb70a41cc65d91971e9d2f0e51394341e89252fae8642683e27f277c37: Status 404 returned error can't find the container with id 461adbbb70a41cc65d91971e9d2f0e51394341e89252fae8642683e27f277c37
Sep 17 01:39:14.420425 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.420388    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:14.420531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.420465    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:14.420531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.420491    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:14.490568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.490545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:14.779751 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.779665    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:39:14.842706 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.842673    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerStarted","Data":"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"}
Sep 17 01:39:14.842900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.842723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerStarted","Data":"461adbbb70a41cc65d91971e9d2f0e51394341e89252fae8642683e27f277c37"}
Sep 17 01:39:14.844114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.844090    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" event={"ID":"9b5be3e4-7478-4416-86db-7b46fa3dfaea","Type":"ContainerStarted","Data":"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"}
Sep 17 01:39:14.883551 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.883475    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podStartSLOduration=1.8834613340000002 podStartE2EDuration="1.883461334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:14.88183797 +0000 UTC m=+1053.525946069" watchObservedRunningTime="2026-09-17 01:39:14.883461334 +0000 UTC m=+1053.527569467"
Sep 17 01:39:14.913686 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:14.913638    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" podStartSLOduration=2.344268841 podStartE2EDuration="2.913621882s" totalImagesPullingTime="569.353041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:14.911391799 +0000 UTC m=+1053.555499898" watchObservedRunningTime="2026-09-17 01:39:14.913621882 +0000 UTC m=+1053.557730000"
Sep 17 01:39:15.130631 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.130600    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:15.135664 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.135641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:15.484255 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.484157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:15.849849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.849749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:15.850453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.850391    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:15.851726 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:15.851697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:16.185518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:16.185485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:16.283047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:16.283013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:16.384983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:16.384949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:17.215632 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:17.215594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:18.021264 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:18.021230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:18.922737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:18.922662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:19.014954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.014915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:19.418707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.418667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:19.520799 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.518931    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:19.526906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.526872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:19.529933 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.529880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.530911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.530879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:19.534245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.534226    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4889635f\""
Sep 17 01:39:19.534649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.534633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4889635f-dockercfg-7xbht\""
Sep 17 01:39:19.599054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.599029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:19.674555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.674465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfcqf\" (UniqueName: \"kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.674555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.674530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.775444 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.775407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfcqf\" (UniqueName: \"kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.775628 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.775465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.776248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.776219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.782574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.782546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfcqf\" (UniqueName: \"kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf\") pod \"payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:19.848432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:19.848403    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:20.130241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:20.130195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:20.139754 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:20.139726    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e0d82b_01c0_4cec_992e_fe240179950d.slice/crio-c99254192cdc45107f411cb3e6bbe88f6069158872e022a09145672ddb7950a4 WatchSource:0}: Error finding container c99254192cdc45107f411cb3e6bbe88f6069158872e022a09145672ddb7950a4: Status 404 returned error can't find the container with id c99254192cdc45107f411cb3e6bbe88f6069158872e022a09145672ddb7950a4
Sep 17 01:39:20.878422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:20.878389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" event={"ID":"44e0d82b-01c0-4cec-992e-fe240179950d","Type":"ContainerStarted","Data":"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"}
Sep 17 01:39:20.878595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:20.878440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" event={"ID":"44e0d82b-01c0-4cec-992e-fe240179950d","Type":"ContainerStarted","Data":"c99254192cdc45107f411cb3e6bbe88f6069158872e022a09145672ddb7950a4"}
Sep 17 01:39:20.878595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:20.878471    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:20.894566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:20.894517    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" podStartSLOduration=1.8945045280000001 podStartE2EDuration="1.894504528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:20.892708103 +0000 UTC m=+1059.536816192" watchObservedRunningTime="2026-09-17 01:39:20.894504528 +0000 UTC m=+1059.538612638"
Sep 17 01:39:23.836915 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:23.836872    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 01:39:23.837337 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:23.836945    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 01:39:24.565085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:24.565042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:24.659808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:24.659756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:24.762791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:24.762753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:24.846936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:24.846869    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:39:24.981742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:24.981708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:25.906238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.906207    2573 generic.go:356] "Generic (PLEG): container finished" podID="78b3758c-5438-4860-bbb9-36584dab3207" containerID="55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35" exitCode=0
Sep 17 01:39:25.906687 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.906283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerDied","Data":"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"}
Sep 17 01:39:25.906738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.906686    2573 scope.go:117] "RemoveContainer" containerID="55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"
Sep 17 01:39:25.907755 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.907730    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:25.907844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.907821    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:25.907890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:25.907868    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:26.859701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:26.859663    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:39:26.918151 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:26.918109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerStarted","Data":"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"}
Sep 17 01:39:26.978843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:26.978811    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:26.978843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:26.978827    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:26.979111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:26.978881    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:27.978888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:27.978850    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:27.979278 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:27.978904    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:28.978628 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:28.978586    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:28.978851 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:28.978654    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:29.978535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:29.978506    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:29.978998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:29.978681    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:30.474634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.474594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:30.530905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.530846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:30.610751 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.610707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:30.709707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.709662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:30.811155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.811057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:30.978673 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.978636    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:30.979059 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:30.978697    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:31.243993 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:31.243943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:31.886080 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:31.886055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:31.978186 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:31.978150    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 17 01:39:31.978386 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:31.978217    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 17 01:39:32.092793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:32.092735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:32.591141 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:32.591101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:32.981919 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:32.981887    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:32.982187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:32.982160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:32.983407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:32.983384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:39:33.009480 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:33.009452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:33.110128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:33.110093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:33.212338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:33.212304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:33.779108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:33.779072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:34.310533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.310441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:34.971925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.971849    2573 generic.go:356] "Generic (PLEG): container finished" podID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerID="5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062" exitCode=0
Sep 17 01:39:34.972104 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.971924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerDied","Data":"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"}
Sep 17 01:39:34.972461 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.972442    2573 scope.go:117] "RemoveContainer" containerID="5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"
Sep 17 01:39:34.973526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.973496    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:34.973603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.973583    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:34.973659 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:34.973629    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:35.066702 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:35.066634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:39:35.162153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:35.162119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:35.978971 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:35.978936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerStarted","Data":"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"}
Sep 17 01:39:36.008025 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.007989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:36.130824 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.130787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:36.131030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.130887    2573 patch_prober.go:28] interesting pod/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 17 01:39:36.131030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.130943    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 17 01:39:36.484472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.484435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:36.552366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.552324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:36.765911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:36.765827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:37.131372 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:37.131333    2573 patch_prober.go:28] interesting pod/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 17 01:39:37.132168 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:37.132136    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 17 01:39:37.719419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:37.719384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.131608 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.131564    2573 patch_prober.go:28] interesting pod/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 17 01:39:38.132126 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.131634    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 17 01:39:38.155434 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.155404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.279626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.279582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.419630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.419530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.591683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.591652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.691743 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.691663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.791430 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.791403    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.903644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.903615    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:39:38.907327 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.907305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.912229 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.912194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d370b3-openshift-default-dockercfg-2wt9v\""
Sep 17 01:39:38.928793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.925249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:39:38.944124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.944056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:38.962924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.962898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.962940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.962976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.962991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.963007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.963022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.963047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.963077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:38.963210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:38.963095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prx22\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063737    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063793    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prx22\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.063904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.063862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.064665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.064633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.064913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.064890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.065210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.065178    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.065210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.065183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.065362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.065266    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.067196 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.067174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.068256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.068235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.077254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.077226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:39.080227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.080196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.080972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.080947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prx22\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22\") pod \"e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") " pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.131996 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.131958    2573 patch_prober.go:28] interesting pod/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 17 01:39:39.133046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.132615    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 17 01:39:39.219834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.219720    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:39.243595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.243549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:39.544793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.544749    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:39:39.546643 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:39.546616    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee12ff34_c31b_4fbc_999a_3416df3fe3cc.slice/crio-f9782efa9f2c4a9d5584b9ebb53530f54c006fbc494cc1c07c78864260410098 WatchSource:0}: Error finding container f9782efa9f2c4a9d5584b9ebb53530f54c006fbc494cc1c07c78864260410098: Status 404 returned error can't find the container with id f9782efa9f2c4a9d5584b9ebb53530f54c006fbc494cc1c07c78864260410098
Sep 17 01:39:39.548998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.548964    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:39.549084 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.549048    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:39.549122 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.549087    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:39:39.999960 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.999924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerStarted","Data":"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"}
Sep 17 01:39:40.000133 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:39.999986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerStarted","Data":"f9782efa9f2c4a9d5584b9ebb53530f54c006fbc494cc1c07c78864260410098"}
Sep 17 01:39:40.021832 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.021760    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podStartSLOduration=2.021738922 podStartE2EDuration="2.021738922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:40.019549108 +0000 UTC m=+1078.663657217" watchObservedRunningTime="2026-09-17 01:39:40.021738922 +0000 UTC m=+1078.665847003"
Sep 17 01:39:40.131269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.131233    2573 patch_prober.go:28] interesting pod/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 17 01:39:40.131580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.131549    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 17 01:39:40.136511 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.136431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:40.244440 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.244406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:40.250179 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:40.249979    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:41.001980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.001945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:41.005311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.005289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:41.006184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.006165    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:39:41.377099 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.377058    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:41.377567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.377457    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:41.378523 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.378497    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:39:41.653300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.653223    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"]
Sep 17 01:39:41.656891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.656872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:41.659323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.659302    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:39:41.663834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.663811    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"]
Sep 17 01:39:41.789515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.789485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4889635f-45db6\" (UID: \"25e5f2be-0c73-474a-9570-c0bae670dc7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:41.792908 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.792883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:41.891062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.891028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4889635f-45db6\" (UID: \"25e5f2be-0c73-474a-9570-c0bae670dc7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:41.891662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.891641    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4889635f-45db6\" (UID: \"25e5f2be-0c73-474a-9570-c0bae670dc7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:41.971214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.971118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:39:41.979365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.979336    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:41.999867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:41.999764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:42.099002 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:42.098969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:42.260759 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:42.260679    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"]
Sep 17 01:39:42.264374 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:42.264344    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e5f2be_0c73_474a_9570_c0bae670dc7b.slice/crio-1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984 WatchSource:0}: Error finding container 1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984: Status 404 returned error can't find the container with id 1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984
Sep 17 01:39:42.598752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:42.598668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:43.017113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:43.017043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6" event={"ID":"25e5f2be-0c73-474a-9570-c0bae670dc7b","Type":"ContainerStarted","Data":"1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984"}
Sep 17 01:39:43.311646 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:43.311556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:44.127165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:44.127127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:44.466960 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:44.466933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:44.785077 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:44.784993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:45.028846 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:45.028814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6" event={"ID":"25e5f2be-0c73-474a-9570-c0bae670dc7b","Type":"ContainerStarted","Data":"55829f16b97b8d4fc3c6e311eaf8ed66566bbb0256aa0eb5956f9535f7606b4c"}
Sep 17 01:39:45.045636 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:45.045534    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6" podStartSLOduration=1.880300712 podStartE2EDuration="4.04552115s" totalImagesPullingTime="2.165220438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:45.044005171 +0000 UTC m=+1083.688113269" watchObservedRunningTime="2026-09-17 01:39:45.04552115 +0000 UTC m=+1083.689629230"
Sep 17 01:39:45.615049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:45.615017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:45.715587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:45.715556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:45.922798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:45.922705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:46.036973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.036937    2573 generic.go:356] "Generic (PLEG): container finished" podID="25e5f2be-0c73-474a-9570-c0bae670dc7b" containerID="55829f16b97b8d4fc3c6e311eaf8ed66566bbb0256aa0eb5956f9535f7606b4c" exitCode=0
Sep 17 01:39:46.037161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.037017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6" event={"ID":"25e5f2be-0c73-474a-9570-c0bae670dc7b","Type":"ContainerDied","Data":"55829f16b97b8d4fc3c6e311eaf8ed66566bbb0256aa0eb5956f9535f7606b4c"}
Sep 17 01:39:46.075255 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.075228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:46.174420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.174315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:46.180801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.180763    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:39:46.184108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.184092    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.186488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.186460    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d370b3\""
Sep 17 01:39:46.186921 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.186902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d370b3-dockercfg-295dg\""
Sep 17 01:39:46.194279 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.194254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:39:46.196972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.196953    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:39:46.200453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.200437    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.208268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.208233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:39:46.232741 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.232715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.232867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.232791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stgf2\" (UniqueName: \"kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.333567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.333535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.333728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.333598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5jh\" (UniqueName: \"kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.333728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.333633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stgf2\" (UniqueName: \"kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.333728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.333669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.334333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.334312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.342413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.342383    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stgf2\" (UniqueName: \"kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2\") pod \"payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.434421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.434342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5jh\" (UniqueName: \"kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.434421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.434401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.435200 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.435179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.441890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.441858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5jh\" (UniqueName: \"kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh\") pod \"payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.465331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.465306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:46.495450 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.495422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:46.512238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.512078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:46.776381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.776335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:39:46.778632 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:46.778606    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2789fdc9_3f71_4baa_b041_ea996f1bba21.slice/crio-f21136265dd3dc15cbeed87918f490c2f242de61d19368d650d13e9656d5cdb5 WatchSource:0}: Error finding container f21136265dd3dc15cbeed87918f490c2f242de61d19368d650d13e9656d5cdb5: Status 404 returned error can't find the container with id f21136265dd3dc15cbeed87918f490c2f242de61d19368d650d13e9656d5cdb5
Sep 17 01:39:46.800270 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:46.800245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:39:46.812016 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:39:46.811989    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294be512_1a0c_477f_ab24_04b7e15d04ab.slice/crio-a0a927288c08fdca601bae22a332520f2ff648226df06d48f2a4139120fcef4e WatchSource:0}: Error finding container a0a927288c08fdca601bae22a332520f2ff648226df06d48f2a4139120fcef4e: Status 404 returned error can't find the container with id a0a927288c08fdca601bae22a332520f2ff648226df06d48f2a4139120fcef4e
Sep 17 01:39:47.014870 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.014834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:47.043928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.043820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" event={"ID":"294be512-1a0c-477f-ab24-04b7e15d04ab","Type":"ContainerStarted","Data":"0870dfe86ba2ccefca85995de472503705d623a975550469ecdcc1272cb66fbf"}
Sep 17 01:39:47.043928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.043888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" event={"ID":"294be512-1a0c-477f-ab24-04b7e15d04ab","Type":"ContainerStarted","Data":"a0a927288c08fdca601bae22a332520f2ff648226df06d48f2a4139120fcef4e"}
Sep 17 01:39:47.044154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.044027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:47.045523 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.045493    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" event={"ID":"2789fdc9-3f71-4baa-b041-ea996f1bba21","Type":"ContainerStarted","Data":"69e6020b61c69ef3a776c39babc628cba87d2fd8b58fe01f671f58cf946b130c"}
Sep 17 01:39:47.045651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.045555    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" event={"ID":"2789fdc9-3f71-4baa-b041-ea996f1bba21","Type":"ContainerStarted","Data":"f21136265dd3dc15cbeed87918f490c2f242de61d19368d650d13e9656d5cdb5"}
Sep 17 01:39:47.059839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.059788    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" podStartSLOduration=1.059758197 podStartE2EDuration="1.059758197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:47.058267052 +0000 UTC m=+1085.702375159" watchObservedRunningTime="2026-09-17 01:39:47.059758197 +0000 UTC m=+1085.703866276"
Sep 17 01:39:47.075314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.074545    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" podStartSLOduration=1.074524323 podStartE2EDuration="1.074524323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:47.072719611 +0000 UTC m=+1085.716827707" watchObservedRunningTime="2026-09-17 01:39:47.074524323 +0000 UTC m=+1085.718632406"
Sep 17 01:39:47.165386 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.165360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:47.247597 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.247568    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca\") pod \"25e5f2be-0c73-474a-9570-c0bae670dc7b\" (UID: \"25e5f2be-0c73-474a-9570-c0bae670dc7b\") "
Sep 17 01:39:47.248019 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.247993    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25e5f2be-0c73-474a-9570-c0bae670dc7b" (UID: "25e5f2be-0c73-474a-9570-c0bae670dc7b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:39:47.348658 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:47.348572    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25e5f2be-0c73-474a-9570-c0bae670dc7b-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:39:48.051975 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:48.051932    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6" event={"ID":"25e5f2be-0c73-474a-9570-c0bae670dc7b","Type":"ContainerDied","Data":"1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984"}
Sep 17 01:39:48.052325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:48.051997    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1179986615b726e44477f0a6c145c74095d09b0b58eceae8b4d7a3cf2e9fe984"
Sep 17 01:39:48.052325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:48.051945    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"
Sep 17 01:39:48.052325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:48.052090    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:49.676663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:49.676628    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:39:57.978217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:57.978172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.054588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.054553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:39:58.513117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.513078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.546674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.546631    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:58.547022 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.546985    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" podUID="44e0d82b-01c0-4cec-992e-fe240179950d" containerName="payload-pre-processing" containerID="cri-o://c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c" gracePeriod=30
Sep 17 01:39:58.615032 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.614998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.714890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.714815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.715585 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.715553    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"]
Sep 17 01:39:58.717321 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.717287    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4889635f-45db6"]
Sep 17 01:39:58.776496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.776415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.832175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.828794    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:58.844904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.843522    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:39:58.844904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.843758    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy" containerID="cri-o://2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753" gracePeriod=30
Sep 17 01:39:58.870900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.870749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:58.970015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.969926    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume\") pod \"44e0d82b-01c0-4cec-992e-fe240179950d\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") "
Sep 17 01:39:58.970015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.969994    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfcqf\" (UniqueName: \"kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf\") pod \"44e0d82b-01c0-4cec-992e-fe240179950d\" (UID: \"44e0d82b-01c0-4cec-992e-fe240179950d\") "
Sep 17 01:39:58.970397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.970368    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44e0d82b-01c0-4cec-992e-fe240179950d" (UID: "44e0d82b-01c0-4cec-992e-fe240179950d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:39:58.972873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:58.972845    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf" (OuterVolumeSpecName: "kube-api-access-qfcqf") pod "44e0d82b-01c0-4cec-992e-fe240179950d" (UID: "44e0d82b-01c0-4cec-992e-fe240179950d"). InnerVolumeSpecName "kube-api-access-qfcqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:39:59.059829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.059795    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:39:59.071382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.071352    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0d82b-01c0-4cec-992e-fe240179950d-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:39:59.071382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.071381    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfcqf\" (UniqueName: \"kubernetes.io/projected/44e0d82b-01c0-4cec-992e-fe240179950d-kube-api-access-qfcqf\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:39:59.110641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.110609    2573 generic.go:356] "Generic (PLEG): container finished" podID="44e0d82b-01c0-4cec-992e-fe240179950d" containerID="c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c" exitCode=0
Sep 17 01:39:59.110836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.110661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" event={"ID":"44e0d82b-01c0-4cec-992e-fe240179950d","Type":"ContainerDied","Data":"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"}
Sep 17 01:39:59.110836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.110709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr" event={"ID":"44e0d82b-01c0-4cec-992e-fe240179950d","Type":"ContainerDied","Data":"c99254192cdc45107f411cb3e6bbe88f6069158872e022a09145672ddb7950a4"}
Sep 17 01:39:59.110836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.110738    2573 scope.go:117] "RemoveContainer" containerID="c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"
Sep 17 01:39:59.111002 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.110919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"
Sep 17 01:39:59.122040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.122018    2573 scope.go:117] "RemoveContainer" containerID="c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"
Sep 17 01:39:59.122393 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:39:59.122368    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c\": container with ID starting with c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c not found: ID does not exist" containerID="c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"
Sep 17 01:39:59.122459 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.122405    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c"} err="failed to get container status \"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c\": rpc error: code = NotFound desc = could not find container \"c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c\": container with ID starting with c2771a18bf72963d5c0a2bcdbf17d0092b88f64e901b2d3837bf7882bc013b0c not found: ID does not exist"
Sep 17 01:39:59.137322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.137282    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:59.139998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.139975    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr"]
Sep 17 01:39:59.193273 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.193249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:59.325060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.324977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:59.427881 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.427843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:59.533016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.532981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:59.800035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.799996    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e5f2be-0c73-474a-9570-c0bae670dc7b" path="/var/lib/kubelet/pods/25e5f2be-0c73-474a-9570-c0bae670dc7b/volumes"
Sep 17 01:39:59.800524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.800495    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e0d82b-01c0-4cec-992e-fe240179950d" path="/var/lib/kubelet/pods/44e0d82b-01c0-4cec-992e-fe240179950d/volumes"
Sep 17 01:39:59.816262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.816238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:39:59.916092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:39:59.916056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:00.017034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.016989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:00.117350 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.117318    2573 generic.go:356] "Generic (PLEG): container finished" podID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerID="92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1" exitCode=0
Sep 17 01:40:00.117740 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.117392    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerDied","Data":"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"}
Sep 17 01:40:00.117907 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.117881    2573 scope.go:117] "RemoveContainer" containerID="92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"
Sep 17 01:40:00.119137 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.119110    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:00.119211 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.119183    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:00.119254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.119216    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:00.693045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:00.693004    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:01.128312 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:01.128271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerStarted","Data":"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"}
Sep 17 01:40:01.243875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:01.243835    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:40:01.244141 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:01.244100    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:40:01.244214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:01.244188    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 17 01:40:01.492453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:01.492372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:02.141021 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:02.140992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:02.241606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:02.241562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:02.244707 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:02.244681    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:40:02.244801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:02.244751    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 17 01:40:02.342120 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:02.342079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:03.244547 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.244503    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:40:03.244943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.244580    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 17 01:40:03.478841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.478810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:03.579361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.579283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:03.733241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.733202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:03.941073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:03.940786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:04.041072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.040900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:04.086498 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086470    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:04.086852 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086838    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e0d82b-01c0-4cec-992e-fe240179950d" containerName="payload-pre-processing"
Sep 17 01:40:04.086935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086854    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e0d82b-01c0-4cec-992e-fe240179950d" containerName="payload-pre-processing"
Sep 17 01:40:04.086935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086871    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e5f2be-0c73-474a-9570-c0bae670dc7b" containerName="revoke-keys"
Sep 17 01:40:04.086935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086877    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e5f2be-0c73-474a-9570-c0bae670dc7b" containerName="revoke-keys"
Sep 17 01:40:04.087095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086954    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44e0d82b-01c0-4cec-992e-fe240179950d" containerName="payload-pre-processing"
Sep 17 01:40:04.087095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.086963    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e5f2be-0c73-474a-9570-c0bae670dc7b" containerName="revoke-keys"
Sep 17 01:40:04.090496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.090477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.093249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.093231    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c7f22faa-dockercfg-m2gxx\""
Sep 17 01:40:04.093346 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.093282    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c7f22faa\""
Sep 17 01:40:04.100381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.100335    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:04.140009 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.139920    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:04.144602 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.144572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.148622 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.148597    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:40:04.150816 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.150741    2573 generic.go:356] "Generic (PLEG): container finished" podID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerID="2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753" exitCode=0
Sep 17 01:40:04.150930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.150843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerDied","Data":"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"}
Sep 17 01:40:04.150930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.150916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2" event={"ID":"c0c58577-e504-48e1-8b42-47cd3ffbab67","Type":"ContainerDied","Data":"461adbbb70a41cc65d91971e9d2f0e51394341e89252fae8642683e27f277c37"}
Sep 17 01:40:04.151050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.150948    2573 scope.go:117] "RemoveContainer" containerID="2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"
Sep 17 01:40:04.152842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.152744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:04.163215 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.163195    2573 scope.go:117] "RemoveContainer" containerID="5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"
Sep 17 01:40:04.176999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.176973    2573 scope.go:117] "RemoveContainer" containerID="2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"
Sep 17 01:40:04.177462 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:40:04.177426    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753\": container with ID starting with 2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753 not found: ID does not exist" containerID="2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"
Sep 17 01:40:04.177571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.177462    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753"} err="failed to get container status \"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753\": rpc error: code = NotFound desc = could not find container \"2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753\": container with ID starting with 2c61c81c633e9711d9813dccd8c3c7ed03094643af5ef409ba15e66e68556753 not found: ID does not exist"
Sep 17 01:40:04.177571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.177483    2573 scope.go:117] "RemoveContainer" containerID="5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"
Sep 17 01:40:04.179476 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:40:04.178982    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062\": container with ID starting with 5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062 not found: ID does not exist" containerID="5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"
Sep 17 01:40:04.180017 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.179895    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062"} err="failed to get container status \"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062\": rpc error: code = NotFound desc = could not find container \"5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062\": container with ID starting with 5b88bb82c24325dfedc6a535138067649305a90e34c38aa61375b38603335062 not found: ID does not exist"
Sep 17 01:40:04.235251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.235210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.235448 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.235356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzd54\" (UniqueName: \"kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.244023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.243997    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:40:04.244142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.244084    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 17 01:40:04.336379 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336338    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336388    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336427    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336451    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjrjx\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336478    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336586    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:40:04.336884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket\") pod \"c0c58577-e504-48e1-8b42-47cd3ffbab67\" (UID: \"c0c58577-e504-48e1-8b42-47cd3ffbab67\") "
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336941    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.336957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzd54\" (UniqueName: \"kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7crgt\" (UniqueName: \"kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337258    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.337404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337290    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.337744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337415    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:40:04.337744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:40:04.337900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.337855    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:40:04.339044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.338346    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.339420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.339379    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx" (OuterVolumeSpecName: "kube-api-access-mjrjx") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "kube-api-access-mjrjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:40:04.340040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.340017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:40:04.340040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.340023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:40:04.340161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.340057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0c58577-e504-48e1-8b42-47cd3ffbab67" (UID: "c0c58577-e504-48e1-8b42-47cd3ffbab67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:40:04.344633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.344599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzd54\" (UniqueName: \"kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54\") pod \"payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") " pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.402541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.402475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:04.414304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.414276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:04.438436 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.438436 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7crgt\" (UniqueName: \"kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438512    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0c58577-e504-48e1-8b42-47cd3ffbab67-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438524    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438532    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438541    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0c58577-e504-48e1-8b42-47cd3ffbab67-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438549    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438558    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0c58577-e504-48e1-8b42-47cd3ffbab67-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.438634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.438566    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjrjx\" (UniqueName: \"kubernetes.io/projected/c0c58577-e504-48e1-8b42-47cd3ffbab67-kube-api-access-mjrjx\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:04.439453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.439428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.450471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.450450    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7crgt\" (UniqueName: \"kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt\") pod \"payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.456333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.456312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:04.708280 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.708218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:04.767962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.767939    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:04.769680 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:40:04.769650    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9c3242_e6aa_49db_9cdf_9e0e822b4241.slice/crio-5e2a29b610717e7b8be6e0e7056d339a058d09af131727331fbfa90daa592ffc WatchSource:0}: Error finding container 5e2a29b610717e7b8be6e0e7056d339a058d09af131727331fbfa90daa592ffc: Status 404 returned error can't find the container with id 5e2a29b610717e7b8be6e0e7056d339a058d09af131727331fbfa90daa592ffc
Sep 17 01:40:04.781121 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:04.781095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:40:05.158322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.158211    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"
Sep 17 01:40:05.160434 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.160404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" event={"ID":"3416519e-7e48-4741-8239-794dd9f262ac","Type":"ContainerStarted","Data":"af2c626bbfd2e2edc5de3f059609930e1fa826b01e554141a17e7b3d9daa18b0"}
Sep 17 01:40:05.160634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.160618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" event={"ID":"3416519e-7e48-4741-8239-794dd9f262ac","Type":"ContainerStarted","Data":"edc754cb10f9014689e1bf3fa9507001983acecf08d3d0a99ae2dd3ce6f4d534"}
Sep 17 01:40:05.161268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.161246    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:05.163496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.163356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" event={"ID":"6f9c3242-e6aa-49db-9cdf-9e0e822b4241","Type":"ContainerStarted","Data":"e70253d9aef1ed5c76e0ee6769395771a444018e8a642e1fac87983692b618d3"}
Sep 17 01:40:05.163496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.163410    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:05.163496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.163435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" event={"ID":"6f9c3242-e6aa-49db-9cdf-9e0e822b4241","Type":"ContainerStarted","Data":"5e2a29b610717e7b8be6e0e7056d339a058d09af131727331fbfa90daa592ffc"}
Sep 17 01:40:05.180951 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.180914    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" podStartSLOduration=1.180902262 podStartE2EDuration="1.180902262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:40:05.179594458 +0000 UTC m=+1103.823702553" watchObservedRunningTime="2026-09-17 01:40:05.180902262 +0000 UTC m=+1103.825010340"
Sep 17 01:40:05.204760 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.204714    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" podStartSLOduration=1.2047006630000001 podStartE2EDuration="1.204700663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:40:05.202468994 +0000 UTC m=+1103.846577093" watchObservedRunningTime="2026-09-17 01:40:05.204700663 +0000 UTC m=+1103.848808741"
Sep 17 01:40:05.219861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.219833    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:40:05.223736 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.223710    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2"]
Sep 17 01:40:05.238286 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.238247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:05.244983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.244947    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:40:05.245066 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.245005    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 17 01:40:05.801979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.800358    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" path="/var/lib/kubelet/pods/c0c58577-e504-48e1-8b42-47cd3ffbab67/volumes"
Sep 17 01:40:05.995366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:05.995330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:06.368890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:06.368856    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:40:06.369389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:06.369359    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:40:06.370323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:06.370303    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:40:06.627020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:06.626930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:06.866451 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:06.866424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:07.387920 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:07.387889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:08.019472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:08.019439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:15.576738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:15.576704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:16.170745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:16.170716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:17.174933 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:17.174906    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:22.571069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:22.571036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:40:25.326419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:25.326361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:25.954967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:25.954933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:26.590045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:26.590003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:27.088806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.088755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"]
Sep 17 01:40:27.089175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.089159    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:27.089175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.089176    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:27.089291 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.089278    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:27.092607 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.092588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:27.094947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.094928    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:40:27.099069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.099047    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"]
Sep 17 01:40:27.233426 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.233386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27\" (UID: \"2b639adc-0e44-49e6-b49e-42af677d03eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:27.334815 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.334758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27\" (UID: \"2b639adc-0e44-49e6-b49e-42af677d03eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:27.335394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.335367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27\" (UID: \"2b639adc-0e44-49e6-b49e-42af677d03eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:27.355345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.355316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:27.406050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.406029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:27.682264 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:27.682237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"]
Sep 17 01:40:27.683828 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:40:27.683803    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b639adc_0e44_49e6_b49e_42af677d03eb.slice/crio-2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197 WatchSource:0}: Error finding container 2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197: Status 404 returned error can't find the container with id 2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197
Sep 17 01:40:28.013604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:28.013534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:28.276178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:28.276096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27" event={"ID":"2b639adc-0e44-49e6-b49e-42af677d03eb","Type":"ContainerStarted","Data":"327b1e388841d19c5a07752b452c37ab49fd3aed30736170bc328c8ef2590467"}
Sep 17 01:40:28.276178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:28.276153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27" event={"ID":"2b639adc-0e44-49e6-b49e-42af677d03eb","Type":"ContainerStarted","Data":"2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197"}
Sep 17 01:40:28.292256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:28.292208    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27" podStartSLOduration=1.2921928409999999 podStartE2EDuration="1.292192841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:40:28.290478448 +0000 UTC m=+1126.934586543" watchObservedRunningTime="2026-09-17 01:40:28.292192841 +0000 UTC m=+1126.936300961"
Sep 17 01:40:28.859915 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:28.859879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:29.283031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:29.282944    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b639adc-0e44-49e6-b49e-42af677d03eb" containerID="327b1e388841d19c5a07752b452c37ab49fd3aed30736170bc328c8ef2590467" exitCode=0
Sep 17 01:40:29.283031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:29.282986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27" event={"ID":"2b639adc-0e44-49e6-b49e-42af677d03eb","Type":"ContainerDied","Data":"327b1e388841d19c5a07752b452c37ab49fd3aed30736170bc328c8ef2590467"}
Sep 17 01:40:29.492306 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:29.492260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:30.000308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.000279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:30.426705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.426678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:30.567919 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.567843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca\") pod \"2b639adc-0e44-49e6-b49e-42af677d03eb\" (UID: \"2b639adc-0e44-49e6-b49e-42af677d03eb\") "
Sep 17 01:40:30.568193 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.568170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b639adc-0e44-49e6-b49e-42af677d03eb" (UID: "2b639adc-0e44-49e6-b49e-42af677d03eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:40:30.669323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.669287    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b639adc-0e44-49e6-b49e-42af677d03eb-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:30.785629 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:30.785576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:31.295035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:31.295004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"
Sep 17 01:40:31.295403 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:31.295004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27" event={"ID":"2b639adc-0e44-49e6-b49e-42af677d03eb","Type":"ContainerDied","Data":"2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197"}
Sep 17 01:40:31.295403 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:31.295154    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d6dac8c5ef005b7078cef304a4b1a6e11c6fd2ec293ffca72236ce4c8d3a197"
Sep 17 01:40:31.401072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:31.401023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:33.569790 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:33.569733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.110102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.110071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.140435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.140401    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:34.140701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.140663    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" podUID="3416519e-7e48-4741-8239-794dd9f262ac" containerName="payload-processing" containerID="cri-o://af2c626bbfd2e2edc5de3f059609930e1fa826b01e554141a17e7b3d9daa18b0" gracePeriod=30
Sep 17 01:40:34.149191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.149163    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:34.149398 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.149374    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" podUID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" containerName="payload-pre-processing" containerID="cri-o://e70253d9aef1ed5c76e0ee6769395771a444018e8a642e1fac87983692b618d3" gracePeriod=30
Sep 17 01:40:34.174539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.174515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.273397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.273371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.300187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.299535    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"]
Sep 17 01:40:34.302474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.302443    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7f22faa-g8w27"]
Sep 17 01:40:34.319119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.317037    2573 generic.go:356] "Generic (PLEG): container finished" podID="3416519e-7e48-4741-8239-794dd9f262ac" containerID="af2c626bbfd2e2edc5de3f059609930e1fa826b01e554141a17e7b3d9daa18b0" exitCode=0
Sep 17 01:40:34.319119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.317142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" event={"ID":"3416519e-7e48-4741-8239-794dd9f262ac","Type":"ContainerDied","Data":"af2c626bbfd2e2edc5de3f059609930e1fa826b01e554141a17e7b3d9daa18b0"}
Sep 17 01:40:34.322157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.321932    2573 generic.go:356] "Generic (PLEG): container finished" podID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" containerID="e70253d9aef1ed5c76e0ee6769395771a444018e8a642e1fac87983692b618d3" exitCode=0
Sep 17 01:40:34.322157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.322059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" event={"ID":"6f9c3242-e6aa-49db-9cdf-9e0e822b4241","Type":"ContainerDied","Data":"e70253d9aef1ed5c76e0ee6769395771a444018e8a642e1fac87983692b618d3"}
Sep 17 01:40:34.334388 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.334299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.437193 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.437162    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:34.441422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.441016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.474046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.474016    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:34.507487 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.507424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume\") pod \"3416519e-7e48-4741-8239-794dd9f262ac\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") "
Sep 17 01:40:34.507641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.507494    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzd54\" (UniqueName: \"kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54\") pod \"3416519e-7e48-4741-8239-794dd9f262ac\" (UID: \"3416519e-7e48-4741-8239-794dd9f262ac\") "
Sep 17 01:40:34.508693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.508663    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3416519e-7e48-4741-8239-794dd9f262ac" (UID: "3416519e-7e48-4741-8239-794dd9f262ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:40:34.509833 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.509813    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54" (OuterVolumeSpecName: "kube-api-access-hzd54") pod "3416519e-7e48-4741-8239-794dd9f262ac" (UID: "3416519e-7e48-4741-8239-794dd9f262ac"). InnerVolumeSpecName "kube-api-access-hzd54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:40:34.608438 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.608408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume\") pod \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") "
Sep 17 01:40:34.608946 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.608468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7crgt\" (UniqueName: \"kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt\") pod \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\" (UID: \"6f9c3242-e6aa-49db-9cdf-9e0e822b4241\") "
Sep 17 01:40:34.608946 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.608725    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzd54\" (UniqueName: \"kubernetes.io/projected/3416519e-7e48-4741-8239-794dd9f262ac-kube-api-access-hzd54\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:34.608946 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.608746    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3416519e-7e48-4741-8239-794dd9f262ac-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:34.608946 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.608912    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f9c3242-e6aa-49db-9cdf-9e0e822b4241" (UID: "6f9c3242-e6aa-49db-9cdf-9e0e822b4241"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:40:34.610660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.610631    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt" (OuterVolumeSpecName: "kube-api-access-7crgt") pod "6f9c3242-e6aa-49db-9cdf-9e0e822b4241" (UID: "6f9c3242-e6aa-49db-9cdf-9e0e822b4241"). InnerVolumeSpecName "kube-api-access-7crgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:40:34.709947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.709872    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7crgt\" (UniqueName: \"kubernetes.io/projected/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-kube-api-access-7crgt\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:34.709947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.709900    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9c3242-e6aa-49db-9cdf-9e0e822b4241-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:40:34.711144 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.711119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:34.863389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:34.863354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:35.109817 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.109759    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110521    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110544    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110554    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3416519e-7e48-4741-8239-794dd9f262ac" containerName="payload-processing"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110564    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3416519e-7e48-4741-8239-794dd9f262ac" containerName="payload-processing"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110595    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" containerName="payload-pre-processing"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110605    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" containerName="payload-pre-processing"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110618    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b639adc-0e44-49e6-b49e-42af677d03eb" containerName="revoke-keys"
Sep 17 01:40:35.110640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110626    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b639adc-0e44-49e6-b49e-42af677d03eb" containerName="revoke-keys"
Sep 17 01:40:35.111139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110769    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c58577-e504-48e1-8b42-47cd3ffbab67" containerName="istio-proxy"
Sep 17 01:40:35.111139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110800    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" containerName="payload-pre-processing"
Sep 17 01:40:35.111139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110814    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3416519e-7e48-4741-8239-794dd9f262ac" containerName="payload-processing"
Sep 17 01:40:35.111139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.110827    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b639adc-0e44-49e6-b49e-42af677d03eb" containerName="revoke-keys"
Sep 17 01:40:35.114154 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.114131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.116586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.116561    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c9cf09ef-openshift-default-dockercfg-9c564\""
Sep 17 01:40:35.124239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.123914    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:40:35.136024 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.135998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:35.215114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215288 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215288 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215288 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtcq2\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.215579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.215494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtcq2\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.316814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316713    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.317065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.317065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.317065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.316950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.317221 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.317188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.317373 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.317348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.318764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.318730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.319141 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.319119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.325317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.325291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.325458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.325435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtcq2\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2\") pod \"e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") " pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.325806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.325763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:35.330683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.330662    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"
Sep 17 01:40:35.330683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.330670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc" event={"ID":"6f9c3242-e6aa-49db-9cdf-9e0e822b4241","Type":"ContainerDied","Data":"5e2a29b610717e7b8be6e0e7056d339a058d09af131727331fbfa90daa592ffc"}
Sep 17 01:40:35.331536 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.330764    2573 scope.go:117] "RemoveContainer" containerID="e70253d9aef1ed5c76e0ee6769395771a444018e8a642e1fac87983692b618d3"
Sep 17 01:40:35.332490 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.332464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7" event={"ID":"3416519e-7e48-4741-8239-794dd9f262ac","Type":"ContainerDied","Data":"edc754cb10f9014689e1bf3fa9507001983acecf08d3d0a99ae2dd3ce6f4d534"}
Sep 17 01:40:35.332582 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.332518    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"
Sep 17 01:40:35.343278 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.343205    2573 scope.go:117] "RemoveContainer" containerID="af2c626bbfd2e2edc5de3f059609930e1fa826b01e554141a17e7b3d9daa18b0"
Sep 17 01:40:35.354214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.354189    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:35.357645 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.357622    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc"]
Sep 17 01:40:35.367186 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.367134    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:35.370579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.370556    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7"]
Sep 17 01:40:35.424449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.424418    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:35.488818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.488790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:35.698619 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.698594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:40:35.700468 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:40:35.700443    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec43082_6c4d_42e8_9715_e39b2a8905d0.slice/crio-ccd1e8d4db2fac4310273de5c48ecd1ead8ea55b6c1db9252f2344afb93dde4e WatchSource:0}: Error finding container ccd1e8d4db2fac4310273de5c48ecd1ead8ea55b6c1db9252f2344afb93dde4e: Status 404 returned error can't find the container with id ccd1e8d4db2fac4310273de5c48ecd1ead8ea55b6c1db9252f2344afb93dde4e
Sep 17 01:40:35.702645 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.702615    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:35.702712 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.702679    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:35.702712 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.702708    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:40:35.801465 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.801435    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b639adc-0e44-49e6-b49e-42af677d03eb" path="/var/lib/kubelet/pods/2b639adc-0e44-49e6-b49e-42af677d03eb/volumes"
Sep 17 01:40:35.801867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.801849    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3416519e-7e48-4741-8239-794dd9f262ac" path="/var/lib/kubelet/pods/3416519e-7e48-4741-8239-794dd9f262ac/volumes"
Sep 17 01:40:35.802202 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:35.802189    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9c3242-e6aa-49db-9cdf-9e0e822b4241" path="/var/lib/kubelet/pods/6f9c3242-e6aa-49db-9cdf-9e0e822b4241/volumes"
Sep 17 01:40:36.051427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.051325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:36.340821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.340711    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerStarted","Data":"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"}
Sep 17 01:40:36.340821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.340767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerStarted","Data":"ccd1e8d4db2fac4310273de5c48ecd1ead8ea55b6c1db9252f2344afb93dde4e"}
Sep 17 01:40:36.359813 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.359750    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podStartSLOduration=1.359737218 podStartE2EDuration="1.359737218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:40:36.357936682 +0000 UTC m=+1135.002044781" watchObservedRunningTime="2026-09-17 01:40:36.359737218 +0000 UTC m=+1135.003845298"
Sep 17 01:40:36.425365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.425336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:36.430306 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.430280    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:36.678538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:36.678504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:37.346020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:37.345989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:37.346891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:37.346876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:40:37.402638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:37.402597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:37.690123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:37.690085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:37.782340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:37.782302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:38.236663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:38.236632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:38.783683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:38.783650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:39.597217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:39.597181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:40.221486 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:40.221452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:40.990953 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:40.990914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:41.093482 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:41.093452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:41.421013 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:41.420985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:41.517672 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:41.517643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:42.673886 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:42.673854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:40:53.078905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:53.078869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:40:57.768317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:40:57.768282    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:41:00.468723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.468688    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerID="4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce" exitCode=0
Sep 17 01:41:00.469139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.468784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerDied","Data":"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"}
Sep 17 01:41:00.469139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.469136    2573 scope.go:117] "RemoveContainer" containerID="4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"
Sep 17 01:41:00.470306 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.470278    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:41:00.470373 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.470362    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:41:00.470412 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:00.470399    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:41:01.475313 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:01.475281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerStarted","Data":"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"}
Sep 17 01:41:02.425681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:02.425166    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:02.425681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:02.425339    2573 patch_prober.go:28] interesting pod/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 01:41:02.425681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:02.425388    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 01:41:03.013327 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.013283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:03.355527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.355493    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"]
Sep 17 01:41:03.359062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.359041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:03.361479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.361448    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:41:03.366054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.366030    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"]
Sep 17 01:41:03.424887 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.424845    2573 patch_prober.go:28] interesting pod/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 01:41:03.425072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.424909    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 01:41:03.482614 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.482581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp\" (UID: \"ef461144-ae67-4e60-bc8c-a65451c24dc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:03.583593 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.583557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp\" (UID: \"ef461144-ae67-4e60-bc8c-a65451c24dc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:03.584192 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.584170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp\" (UID: \"ef461144-ae67-4e60-bc8c-a65451c24dc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:03.671319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.671241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:03.966537 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:03.966509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"]
Sep 17 01:41:03.968419 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:41:03.968390    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef461144_ae67_4e60_bc8c_a65451c24dc0.slice/crio-1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56 WatchSource:0}: Error finding container 1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56: Status 404 returned error can't find the container with id 1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56
Sep 17 01:41:04.098431 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.098400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:04.425324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.424843    2573 patch_prober.go:28] interesting pod/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 01:41:04.425324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.424940    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 01:41:04.492143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.492042    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp" event={"ID":"ef461144-ae67-4e60-bc8c-a65451c24dc0","Type":"ContainerStarted","Data":"53100fde534b9bc01e6846d1f5d985b1c56e538129dc47c47517905cbbbd8b65"}
Sep 17 01:41:04.492143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.492100    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp" event={"ID":"ef461144-ae67-4e60-bc8c-a65451c24dc0","Type":"ContainerStarted","Data":"1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56"}
Sep 17 01:41:04.682238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:04.682207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:05.425745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:05.425697    2573 patch_prober.go:28] interesting pod/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 01:41:05.426248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:05.425794    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 01:41:05.498787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:05.498749    2573 generic.go:356] "Generic (PLEG): container finished" podID="ef461144-ae67-4e60-bc8c-a65451c24dc0" containerID="53100fde534b9bc01e6846d1f5d985b1c56e538129dc47c47517905cbbbd8b65" exitCode=0
Sep 17 01:41:05.498951 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:05.498805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp" event={"ID":"ef461144-ae67-4e60-bc8c-a65451c24dc0","Type":"ContainerDied","Data":"53100fde534b9bc01e6846d1f5d985b1c56e538129dc47c47517905cbbbd8b65"}
Sep 17 01:41:05.593503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:05.593475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:06.283143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.283106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:06.425358 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.425316    2573 patch_prober.go:28] interesting pod/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 01:41:06.425557 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.425383    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 01:41:06.670567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.670541    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:06.828541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.828437    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca\") pod \"ef461144-ae67-4e60-bc8c-a65451c24dc0\" (UID: \"ef461144-ae67-4e60-bc8c-a65451c24dc0\") "
Sep 17 01:41:06.829099 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.829063    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef461144-ae67-4e60-bc8c-a65451c24dc0" (UID: "ef461144-ae67-4e60-bc8c-a65451c24dc0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:41:06.930081 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:06.930038    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef461144-ae67-4e60-bc8c-a65451c24dc0-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:07.084439 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.084359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:07.346608 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.346514    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:07.430005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.429968    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:07.510689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.510660    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"
Sep 17 01:41:07.510689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.510688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp" event={"ID":"ef461144-ae67-4e60-bc8c-a65451c24dc0","Type":"ContainerDied","Data":"1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56"}
Sep 17 01:41:07.510937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.510743    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1846a5259920f6ad46a4bafa458c6e31239b2aaa66d11ff646bd7de1ca3aea56"
Sep 17 01:41:07.511763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.511743    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:07.776142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:07.776107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:08.754483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.754453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:41:08.754858 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.754842    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef461144-ae67-4e60-bc8c-a65451c24dc0" containerName="revoke-keys"
Sep 17 01:41:08.754858 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.754860    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef461144-ae67-4e60-bc8c-a65451c24dc0" containerName="revoke-keys"
Sep 17 01:41:08.754958 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.754912    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef461144-ae67-4e60-bc8c-a65451c24dc0" containerName="revoke-keys"
Sep 17 01:41:08.757891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.757861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.760688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.760667    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-8be734\"/\"kube-root-ca.crt\""
Sep 17 01:41:08.760811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.760698    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-8be734\"/\"default-dockercfg-fx72h\""
Sep 17 01:41:08.761935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.761915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-8be734\"/\"premium-w0-8be734-kserve-self-signed-certs\""
Sep 17 01:41:08.762047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.761967    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-8be734\"/\"openshift-service-ca.crt\""
Sep 17 01:41:08.766425 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.766102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:41:08.782545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.782524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:08.851598 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.851714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.851754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.851754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.851882 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.851882 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.851823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p64g\" (UniqueName: \"kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p64g\" (UniqueName: \"kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952686 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952686 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952686 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.952892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.953018 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.952904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.954994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.954967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.955282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.955262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:08.960256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:08.960235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p64g\" (UniqueName: \"kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g\") pod \"premium-w0-8be734-kserve-d577fb5ff-ht98n\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") " pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:09.069902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.069809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:09.095397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.095369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:09.359541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.359509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:41:09.360768 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:41:09.360739    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7cf864a_eab8_46a0_9283_4f53646beeac.slice/crio-607f3a289083007d431037c915bfd9ad9f14cf1ab5772eea7def51777f36888a WatchSource:0}: Error finding container 607f3a289083007d431037c915bfd9ad9f14cf1ab5772eea7def51777f36888a: Status 404 returned error can't find the container with id 607f3a289083007d431037c915bfd9ad9f14cf1ab5772eea7def51777f36888a
Sep 17 01:41:09.522937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.522894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" event={"ID":"f7cf864a-eab8-46a0-9283-4f53646beeac","Type":"ContainerStarted","Data":"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"}
Sep 17 01:41:09.522937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.522940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" event={"ID":"f7cf864a-eab8-46a0-9283-4f53646beeac","Type":"ContainerStarted","Data":"607f3a289083007d431037c915bfd9ad9f14cf1ab5772eea7def51777f36888a"}
Sep 17 01:41:09.539121 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.539070    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" podStartSLOduration=1.5390531969999999 podStartE2EDuration="1.539053197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:41:09.537885103 +0000 UTC m=+1168.181993213" watchObservedRunningTime="2026-09-17 01:41:09.539053197 +0000 UTC m=+1168.183161278"
Sep 17 01:41:09.676532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.676432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:09.776519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.776492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:09.858922 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.858892    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"]
Sep 17 01:41:09.860798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.860755    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9cf09ef-hm6kp"]
Sep 17 01:41:09.878431 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.878404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:09.932166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:09.932097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:10.300796 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:10.300699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:10.901603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:10.901572    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:41:10.902062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:10.901791    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy" containerID="cri-o://ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff" gracePeriod=30
Sep 17 01:41:10.919592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:10.919565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:11.048641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:11.048605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:11.324442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:11.324362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:11.608503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:11.608472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:11.707790 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:11.707743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:11.799338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:11.799299    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef461144-ae67-4e60-bc8c-a65451c24dc0" path="/var/lib/kubelet/pods/ef461144-ae67-4e60-bc8c-a65451c24dc0/volumes"
Sep 17 01:41:12.058366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:12.058278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:12.411235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:12.411192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:13.030239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:13.030202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:13.880588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:13.880555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:14.424237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:14.424196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:14.555406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:14.555373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:14.655051 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:14.655013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:15.189105 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:15.189075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:15.891325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:15.891293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:16.159207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.159178    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:16.321879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321848    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.321879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321882    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtcq2\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321920    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321955    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.321990    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322011    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322035    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket\") pod \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\" (UID: \"2ec43082-6c4d-42e8-9715-e39b2a8905d0\") "
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:41:16.322376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322398    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322422    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322451    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322582    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322605    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322622    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322635    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.322767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.322647    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.324371 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.324347    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:41:16.324371 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.324363    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2" (OuterVolumeSpecName: "kube-api-access-wtcq2") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "kube-api-access-wtcq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:41:16.324654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.324633    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:41:16.324654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.324643    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ec43082-6c4d-42e8-9715-e39b2a8905d0" (UID: "2ec43082-6c4d-42e8-9715-e39b2a8905d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:41:16.424040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.423964    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.424040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.423987    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.424040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.423996    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.424040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.424005    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtcq2\" (UniqueName: \"kubernetes.io/projected/2ec43082-6c4d-42e8-9715-e39b2a8905d0-kube-api-access-wtcq2\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:16.561594 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.561557    2573 generic.go:356] "Generic (PLEG): container finished" podID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerID="ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff" exitCode=0
Sep 17 01:41:16.561762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.561612    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"
Sep 17 01:41:16.561762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.561649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerDied","Data":"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"}
Sep 17 01:41:16.561762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.561708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2" event={"ID":"2ec43082-6c4d-42e8-9715-e39b2a8905d0","Type":"ContainerDied","Data":"ccd1e8d4db2fac4310273de5c48ecd1ead8ea55b6c1db9252f2344afb93dde4e"}
Sep 17 01:41:16.561762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.561731    2573 scope.go:117] "RemoveContainer" containerID="ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"
Sep 17 01:41:16.570901 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.570885    2573 scope.go:117] "RemoveContainer" containerID="4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"
Sep 17 01:41:16.578939 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.578919    2573 scope.go:117] "RemoveContainer" containerID="ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"
Sep 17 01:41:16.579184 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:41:16.579164    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff\": container with ID starting with ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff not found: ID does not exist" containerID="ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"
Sep 17 01:41:16.579234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.579193    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff"} err="failed to get container status \"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff\": rpc error: code = NotFound desc = could not find container \"ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff\": container with ID starting with ff03beaf5108b7919fbcc31ea82daae6d90e1d9a30b2d6d49900f11a16693dff not found: ID does not exist"
Sep 17 01:41:16.579234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.579209    2573 scope.go:117] "RemoveContainer" containerID="4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"
Sep 17 01:41:16.579470 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:41:16.579455    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce\": container with ID starting with 4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce not found: ID does not exist" containerID="4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"
Sep 17 01:41:16.579525 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.579475    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce"} err="failed to get container status \"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce\": rpc error: code = NotFound desc = could not find container \"4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce\": container with ID starting with 4de8e28b807f8cd4921a420c79c13e5b5d67618de7b884864d355d8ee05469ce not found: ID does not exist"
Sep 17 01:41:16.587060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.587035    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:41:16.588604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.588585    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2"]
Sep 17 01:41:16.692390 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:16.692317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:17.494542 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.494515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:17.595949 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.595919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:17.696960 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.696932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:17.799245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.799150    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" path="/var/lib/kubelet/pods/2ec43082-6c4d-42e8-9715-e39b2a8905d0/volumes"
Sep 17 01:41:17.894261 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.894211    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:41:17.955132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:17.955104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:18.055970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.055897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:18.063896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.063869    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:18.064254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064242    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.064298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064257    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.064298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064271    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.064298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064277    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.064396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064344    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.064396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.064354    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec43082-6c4d-42e8-9715-e39b2a8905d0" containerName="istio-proxy"
Sep 17 01:41:18.068913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.068895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.071276 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.071254    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-5f24c314\""
Sep 17 01:41:18.071748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.071731    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-5f24c314-dockercfg-z5k6c\""
Sep 17 01:41:18.077510 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.077485    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:18.093505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.093472    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:18.096815 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.096796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.105900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.105873    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:18.241627 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.241592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.241803 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.241642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgx8v\" (UniqueName: \"kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.241803 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.241668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.241803 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.241726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts82c\" (UniqueName: \"kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.342978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.342904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.342978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.342951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgx8v\" (UniqueName: \"kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.342978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.342975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.343251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.343001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts82c\" (UniqueName: \"kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.343662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.343635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.343762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.343687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.351487 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.351459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts82c\" (UniqueName: \"kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c\") pod \"payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") " pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.351599 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.351584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgx8v\" (UniqueName: \"kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v\") pod \"payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.381556 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.381532    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:18.406605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.406576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:18.657914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.657888    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:18.660267 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:41:18.660240    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5ca5c2_d3ac_445f_84f6_88076ba3bd64.slice/crio-b18e65219ae71d227034900fb336b4b10bf308d0d914c5ced73679757be25564 WatchSource:0}: Error finding container b18e65219ae71d227034900fb336b4b10bf308d0d914c5ced73679757be25564: Status 404 returned error can't find the container with id b18e65219ae71d227034900fb336b4b10bf308d0d914c5ced73679757be25564
Sep 17 01:41:18.689166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:18.689146    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:18.693835 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:41:18.693804    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41251e07_6e1c_4508_b3f0_cf04d4fd4811.slice/crio-970dceae129d38b44271fff04de127958dc449d6805b506b35fdd2fe810287a9 WatchSource:0}: Error finding container 970dceae129d38b44271fff04de127958dc449d6805b506b35fdd2fe810287a9: Status 404 returned error can't find the container with id 970dceae129d38b44271fff04de127958dc449d6805b506b35fdd2fe810287a9
Sep 17 01:41:19.070666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.070529    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:19.070666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.070586    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:19.086251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.086221    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:19.582255 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.582218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" event={"ID":"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64","Type":"ContainerStarted","Data":"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"}
Sep 17 01:41:19.582463 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.582289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:19.582463 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.582313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" event={"ID":"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64","Type":"ContainerStarted","Data":"b18e65219ae71d227034900fb336b4b10bf308d0d914c5ced73679757be25564"}
Sep 17 01:41:19.583978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.583951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" event={"ID":"41251e07-6e1c-4508-b3f0-cf04d4fd4811","Type":"ContainerStarted","Data":"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"}
Sep 17 01:41:19.584110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.584001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" event={"ID":"41251e07-6e1c-4508-b3f0-cf04d4fd4811","Type":"ContainerStarted","Data":"970dceae129d38b44271fff04de127958dc449d6805b506b35fdd2fe810287a9"}
Sep 17 01:41:19.584176 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.584137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:19.595257 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.595232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:41:19.597809 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.597751    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" podStartSLOduration=1.597738245 podStartE2EDuration="1.597738245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:41:19.5959589 +0000 UTC m=+1178.240066997" watchObservedRunningTime="2026-09-17 01:41:19.597738245 +0000 UTC m=+1178.241846324"
Sep 17 01:41:19.627152 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:19.627108    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" podStartSLOduration=1.627091938 podStartE2EDuration="1.627091938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:41:19.62540043 +0000 UTC m=+1178.269508545" watchObservedRunningTime="2026-09-17 01:41:19.627091938 +0000 UTC m=+1178.271200018"
Sep 17 01:41:30.591967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:30.591933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:30.592380 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:30.592240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:38.868911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:38.868871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:41:39.299671 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.299586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:39.361328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.361295    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"]
Sep 17 01:41:39.365509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.365489    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:39.367806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.367762    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:41:39.371812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.371766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"]
Sep 17 01:41:39.417995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.417908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2\" (UID: \"0633536c-77aa-4ae9-95d3-a58acbbf62fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:39.519535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.519493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2\" (UID: \"0633536c-77aa-4ae9-95d3-a58acbbf62fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:39.520423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.520390    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2\" (UID: \"0633536c-77aa-4ae9-95d3-a58acbbf62fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:39.685834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.685797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:39.891009 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.890977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:39.957022 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:39.956995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"]
Sep 17 01:41:39.963252 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:41:39.963211    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0633536c_77aa_4ae9_95d3_a58acbbf62fd.slice/crio-ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89 WatchSource:0}: Error finding container ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89: Status 404 returned error can't find the container with id ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89
Sep 17 01:41:40.514225 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:40.514131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:40.688995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:40.688962    2573 generic.go:356] "Generic (PLEG): container finished" podID="0633536c-77aa-4ae9-95d3-a58acbbf62fd" containerID="fe0cafe27985cc6f9c19b07dd012181718f091b8935856b9de673bc611bef04b" exitCode=0
Sep 17 01:41:40.689146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:40.689050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2" event={"ID":"0633536c-77aa-4ae9-95d3-a58acbbf62fd","Type":"ContainerDied","Data":"fe0cafe27985cc6f9c19b07dd012181718f091b8935856b9de673bc611bef04b"}
Sep 17 01:41:40.689146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:40.689131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2" event={"ID":"0633536c-77aa-4ae9-95d3-a58acbbf62fd","Type":"ContainerStarted","Data":"ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89"}
Sep 17 01:41:41.286118 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:41.286088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:41.836554 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:41.836531    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:41.925839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:41.925808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:41.939918 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:41.939890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca\") pod \"0633536c-77aa-4ae9-95d3-a58acbbf62fd\" (UID: \"0633536c-77aa-4ae9-95d3-a58acbbf62fd\") "
Sep 17 01:41:41.940260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:41.940239    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0633536c-77aa-4ae9-95d3-a58acbbf62fd" (UID: "0633536c-77aa-4ae9-95d3-a58acbbf62fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:41:42.040816 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:42.040761    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0633536c-77aa-4ae9-95d3-a58acbbf62fd-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:42.534332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:42.534303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:42.700734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:42.700694    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2" event={"ID":"0633536c-77aa-4ae9-95d3-a58acbbf62fd","Type":"ContainerDied","Data":"ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89"}
Sep 17 01:41:42.700990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:42.700751    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad8e863b5d02e2f1e3f864a66f5f11d6f2c18261e1598f89583357e5f45f3c89"
Sep 17 01:41:42.700990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:42.700712    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"
Sep 17 01:41:43.297660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:43.297616    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:45.856709 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:45.856678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.375815 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.375769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.398769 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.398737    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:46.399064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.399007    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" podUID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" containerName="payload-processing" containerID="cri-o://01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36" gracePeriod=30
Sep 17 01:41:46.404238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.404200    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:46.404861 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.404832    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" podUID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" containerName="payload-pre-processing" containerID="cri-o://9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d" gracePeriod=30
Sep 17 01:41:46.439246 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.439220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.496389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.496362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.550235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.550197    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"]
Sep 17 01:41:46.552073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.552045    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5f24c314-tt9k2"]
Sep 17 01:41:46.557518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.557491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.687159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.681527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:46.715115 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.715094    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:46.718220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.718193    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:46.720603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.720580    2573 generic.go:356] "Generic (PLEG): container finished" podID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" containerID="01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36" exitCode=0
Sep 17 01:41:46.720694 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.720610    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"
Sep 17 01:41:46.720694 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.720659    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" event={"ID":"41251e07-6e1c-4508-b3f0-cf04d4fd4811","Type":"ContainerDied","Data":"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"}
Sep 17 01:41:46.720801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.720712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5" event={"ID":"41251e07-6e1c-4508-b3f0-cf04d4fd4811","Type":"ContainerDied","Data":"970dceae129d38b44271fff04de127958dc449d6805b506b35fdd2fe810287a9"}
Sep 17 01:41:46.720801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.720741    2573 scope.go:117] "RemoveContainer" containerID="01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"
Sep 17 01:41:46.722068 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.722047    2573 generic.go:356] "Generic (PLEG): container finished" podID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" containerID="9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d" exitCode=0
Sep 17 01:41:46.722146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.722076    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"
Sep 17 01:41:46.722146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.722095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" event={"ID":"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64","Type":"ContainerDied","Data":"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"}
Sep 17 01:41:46.722146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.722134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph" event={"ID":"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64","Type":"ContainerDied","Data":"b18e65219ae71d227034900fb336b4b10bf308d0d914c5ced73679757be25564"}
Sep 17 01:41:46.728870 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.728850    2573 scope.go:117] "RemoveContainer" containerID="01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"
Sep 17 01:41:46.729251 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:41:46.729218    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36\": container with ID starting with 01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36 not found: ID does not exist" containerID="01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"
Sep 17 01:41:46.729394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.729254    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36"} err="failed to get container status \"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36\": rpc error: code = NotFound desc = could not find container \"01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36\": container with ID starting with 01bd6fed20c82b168f19744acabe4e3b4a9e46297a1e2c7215d7581e3cddff36 not found: ID does not exist"
Sep 17 01:41:46.729394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.729275    2573 scope.go:117] "RemoveContainer" containerID="9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"
Sep 17 01:41:46.739704 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.739675    2573 scope.go:117] "RemoveContainer" containerID="9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"
Sep 17 01:41:46.739998 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:41:46.739980    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d\": container with ID starting with 9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d not found: ID does not exist" containerID="9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"
Sep 17 01:41:46.740073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.740007    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d"} err="failed to get container status \"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d\": rpc error: code = NotFound desc = could not find container \"9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d\": container with ID starting with 9e5281125cbe54e700292817250b3b194d711deb3d0ed05ddc18fa54499d5a1d not found: ID does not exist"
Sep 17 01:41:46.783549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.783512    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume\") pod \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") "
Sep 17 01:41:46.783748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.783562    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgx8v\" (UniqueName: \"kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v\") pod \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") "
Sep 17 01:41:46.783748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.783588    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts82c\" (UniqueName: \"kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c\") pod \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\" (UID: \"41251e07-6e1c-4508-b3f0-cf04d4fd4811\") "
Sep 17 01:41:46.783748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.783740    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume\") pod \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\" (UID: \"bd5ca5c2-d3ac-445f-84f6-88076ba3bd64\") "
Sep 17 01:41:46.783982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.783912    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41251e07-6e1c-4508-b3f0-cf04d4fd4811" (UID: "41251e07-6e1c-4508-b3f0-cf04d4fd4811"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:41:46.785464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.784973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" (UID: "bd5ca5c2-d3ac-445f-84f6-88076ba3bd64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:41:46.785464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.785267    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:46.785464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.785290    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41251e07-6e1c-4508-b3f0-cf04d4fd4811-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:46.791204 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.791173    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v" (OuterVolumeSpecName: "kube-api-access-sgx8v") pod "bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" (UID: "bd5ca5c2-d3ac-445f-84f6-88076ba3bd64"). InnerVolumeSpecName "kube-api-access-sgx8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:41:46.791638 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.791621    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c" (OuterVolumeSpecName: "kube-api-access-ts82c") pod "41251e07-6e1c-4508-b3f0-cf04d4fd4811" (UID: "41251e07-6e1c-4508-b3f0-cf04d4fd4811"). InnerVolumeSpecName "kube-api-access-ts82c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:41:46.885792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.885736    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgx8v\" (UniqueName: \"kubernetes.io/projected/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64-kube-api-access-sgx8v\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:46.885792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.885765    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts82c\" (UniqueName: \"kubernetes.io/projected/41251e07-6e1c-4508-b3f0-cf04d4fd4811-kube-api-access-ts82c\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:41:46.962754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:46.962668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:47.045870 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.045837    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:47.049482 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.049458    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5"]
Sep 17 01:41:47.063128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.063104    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:47.067244 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.067225    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph"]
Sep 17 01:41:47.346148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.346069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:47.442794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.442740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:47.509173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.509147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:47.799424 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.799375    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0633536c-77aa-4ae9-95d3-a58acbbf62fd" path="/var/lib/kubelet/pods/0633536c-77aa-4ae9-95d3-a58acbbf62fd/volumes"
Sep 17 01:41:47.799835 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.799815    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" path="/var/lib/kubelet/pods/41251e07-6e1c-4508-b3f0-cf04d4fd4811/volumes"
Sep 17 01:41:47.800159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.800147    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" path="/var/lib/kubelet/pods/bd5ca5c2-d3ac-445f-84f6-88076ba3bd64/volumes"
Sep 17 01:41:47.834048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:47.834022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:48.364261 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:48.364229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:48.851693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:48.851613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:49.096967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:49.096933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:49.825626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:49.825594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:54.367735 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.367679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:54.429483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.429453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:54.527076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.527040    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:54.633042 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.632968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:54.688617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.688593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:41:54.724184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:54.724156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:41:55.070444 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:41:55.070360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:01.987503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:01.987465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:07.841166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:07.841127    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:07.896378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:07.896344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:08.870853 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:08.870818    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:42:20.940982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:20.940946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:26.582323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:26.582283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:26.643577 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:26.643546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:26.716324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:26.716290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:26.810902 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:26.810861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:29.175446 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:29.175408    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:42:35.964271 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964183    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964533    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0633536c-77aa-4ae9-95d3-a58acbbf62fd" containerName="revoke-keys"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964543    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0633536c-77aa-4ae9-95d3-a58acbbf62fd" containerName="revoke-keys"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964551    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" containerName="payload-pre-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964557    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" containerName="payload-pre-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964566    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" containerName="payload-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964572    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" containerName="payload-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964631    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="41251e07-6e1c-4508-b3f0-cf04d4fd4811" containerName="payload-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964640    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5ca5c2-d3ac-445f-84f6-88076ba3bd64" containerName="payload-pre-processing"
Sep 17 01:42:35.964753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.964647    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0633536c-77aa-4ae9-95d3-a58acbbf62fd" containerName="revoke-keys"
Sep 17 01:42:35.968002 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.967980    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:35.970518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.970498    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d370b3\"/\"openshift-service-ca.crt\""
Sep 17 01:42:35.970620 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.970500    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d370b3\"/\"kube-root-ca.crt\""
Sep 17 01:42:35.971431 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.971408    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d370b3\"/\"default-dockercfg-xc59m\""
Sep 17 01:42:35.971697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.971647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d370b3\"/\"test-model-d370b3-kserve-self-signed-certs\""
Sep 17 01:42:35.974505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:35.974457    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:42:36.002207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.002334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.002334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9vbh\" (UniqueName: \"kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.002334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.002493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.002493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.002389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.066164 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.066131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:36.103356 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9vbh\" (UniqueName: \"kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103872 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103953 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.103953 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.103899    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.105562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.105539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.105834 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.105817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.111028 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.110997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9vbh\" (UniqueName: \"kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh\") pod \"test-model-d370b3-kserve-7bbf8584f9-k8xdj\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") " pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.279282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.279202    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:36.549005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.548978    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:42:36.550956 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:42:36.550916    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20d775ba_bb73_472a_98cc_a1a17fc9c30c.slice/crio-87bf1b4eb0d108bf44223abf8dc65777dfc217503a2eaea08b31600b19273e30 WatchSource:0}: Error finding container 87bf1b4eb0d108bf44223abf8dc65777dfc217503a2eaea08b31600b19273e30: Status 404 returned error can't find the container with id 87bf1b4eb0d108bf44223abf8dc65777dfc217503a2eaea08b31600b19273e30
Sep 17 01:42:36.982190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.982154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" event={"ID":"20d775ba-bb73-472a-98cc-a1a17fc9c30c","Type":"ContainerStarted","Data":"1ff1ee9ba82e6984f5f5521f00ab5d3790d2c39e48e964b578f40892ceb00dc3"}
Sep 17 01:42:36.982190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.982196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" event={"ID":"20d775ba-bb73-472a-98cc-a1a17fc9c30c","Type":"ContainerStarted","Data":"87bf1b4eb0d108bf44223abf8dc65777dfc217503a2eaea08b31600b19273e30"}
Sep 17 01:42:36.997806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:36.997743    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" podStartSLOduration=1.99772757 podStartE2EDuration="1.99772757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:36.996211356 +0000 UTC m=+1255.640319468" watchObservedRunningTime="2026-09-17 01:42:36.99772757 +0000 UTC m=+1255.641835649"
Sep 17 01:42:37.127314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:37.127273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:37.180370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:37.180332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:42.566236 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:42.566200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:46.280240 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:46.280207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:46.280605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:46.280466    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:46.292807 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:46.292782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:47.043749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:47.043718    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:42:48.132406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:48.132374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:48.285085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:48.285053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:48.382866 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:48.382754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:51.169311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:51.169278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:42:58.810283 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:58.810249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:58.906746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:58.906715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:42:59.528094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:42:59.528060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:05.471096 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:05.471061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:05.527037 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:05.527005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:05.614482 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:05.614452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:05.713596 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:05.713563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:05.813617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:05.813544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:06.344745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:06.344703    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:06.450072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:06.450037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:06.543079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:06.543041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:07.956217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:07.956174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:10.357504 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.357463    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:43:10.362905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.362883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.366110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.366081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-8be734\"/\"distinct-w0-8be734-kserve-self-signed-certs\""
Sep 17 01:43:10.367327 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.367305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:43:10.373645 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.373624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:10.407928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.407896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7m9\" (UniqueName: \"kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.408033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.407933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.408033 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.408005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.408131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.408029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.408131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.408078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.408222 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.408143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7m9\" (UniqueName: \"kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.509943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.509833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.510210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.510185    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.510389 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.510217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.510483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.510268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.511979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.511958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.512160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.512139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.517321 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.517300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7m9\" (UniqueName: \"kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9\") pod \"distinct-w0-8be734-kserve-7987b4cb54-hj6bb\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") " pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.673143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.673062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:10.945220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:10.945194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:43:10.946991 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:43:10.946964    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac47f9e_50b8_4124_9f00_7bb57b42f044.slice/crio-d765a85da3410faec8667668a14f1c527f6982b95d4fc545de4df15183706247 WatchSource:0}: Error finding container d765a85da3410faec8667668a14f1c527f6982b95d4fc545de4df15183706247: Status 404 returned error can't find the container with id d765a85da3410faec8667668a14f1c527f6982b95d4fc545de4df15183706247
Sep 17 01:43:11.148221 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:11.148186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" event={"ID":"dac47f9e-50b8-4124-9f00-7bb57b42f044","Type":"ContainerStarted","Data":"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"}
Sep 17 01:43:11.148221 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:11.148229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" event={"ID":"dac47f9e-50b8-4124-9f00-7bb57b42f044","Type":"ContainerStarted","Data":"d765a85da3410faec8667668a14f1c527f6982b95d4fc545de4df15183706247"}
Sep 17 01:43:11.165046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:11.164999    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" podStartSLOduration=1.164984181 podStartE2EDuration="1.164984181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:43:11.162829379 +0000 UTC m=+1289.806937477" watchObservedRunningTime="2026-09-17 01:43:11.164984181 +0000 UTC m=+1289.809092259"
Sep 17 01:43:11.721470 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:11.721437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:13.681936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:13.681907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:13.740689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:13.740656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:14.341340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:14.341302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:20.002014 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.001980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:20.103001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.102966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:20.211266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.211240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:20.528827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.528794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:20.673216 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.673183    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:20.673406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.673231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:20.675295 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.675267    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:43:20.686043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.686021    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:20.725214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:20.725188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:21.206529 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:21.206502    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:43:23.102723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:23.102682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:23.226521 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:23.226487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:23.627094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:23.627062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:23.957837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:23.957735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:24.055527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:24.055489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:24.467558 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:24.467524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:25.372818 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:25.372789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:26.005545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:26.005514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:26.793426 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:26.793388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:26.891661 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:26.891625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:26.992236 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:26.992204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:27.242234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.242205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:27.342945 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.342910    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:43:27.345092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.345067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:27.346737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.346719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.349224 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.349207    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-07942c61-dockercfg-qf98g\""
Sep 17 01:43:27.349316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.349209    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-07942c61\""
Sep 17 01:43:27.357328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.357306    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:43:27.461070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.459627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxpw\" (UniqueName: \"kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.461070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.459851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.560421 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.560343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.560562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.560429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxpw\" (UniqueName: \"kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.561087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.561065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.568061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.568036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxpw\" (UniqueName: \"kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw\") pod \"payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.659315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.659284    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:27.930128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:27.930091    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:43:27.933425 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:43:27.933396    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46db52f5_0896_4351_b73b_22c0e1d8b966.slice/crio-e46640f8dcf99012831ddc9027d9f78ce47c03ab8ea0548c124179ae857b5689 WatchSource:0}: Error finding container e46640f8dcf99012831ddc9027d9f78ce47c03ab8ea0548c124179ae857b5689: Status 404 returned error can't find the container with id e46640f8dcf99012831ddc9027d9f78ce47c03ab8ea0548c124179ae857b5689
Sep 17 01:43:28.233489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:28.233391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" event={"ID":"46db52f5-0896-4351-b73b-22c0e1d8b966","Type":"ContainerStarted","Data":"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"}
Sep 17 01:43:28.233489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:28.233451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" event={"ID":"46db52f5-0896-4351-b73b-22c0e1d8b966","Type":"ContainerStarted","Data":"e46640f8dcf99012831ddc9027d9f78ce47c03ab8ea0548c124179ae857b5689"}
Sep 17 01:43:28.233693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:28.233600    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:28.248628 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:28.248578    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" podStartSLOduration=1.248561163 podStartE2EDuration="1.248561163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:43:28.248108827 +0000 UTC m=+1306.892216940" watchObservedRunningTime="2026-09-17 01:43:28.248561163 +0000 UTC m=+1306.892669242"
Sep 17 01:43:31.439340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:31.439306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:39.241129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:39.241093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:43:40.674533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:40.674499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:43:41.881057 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:41.881031    2573 scope.go:117] "RemoveContainer" containerID="cfa2ebc2572c05194d83044dd4e598123a330a7fb26653a181cccf7aa32e5c46"
Sep 17 01:43:48.578134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:48.578095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:48.921790 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:48.921737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:49.388066 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:49.388030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:49.544489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:49.544454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:49.646915 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:49.646826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:49.965182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:49.965104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:50.066299 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:50.066272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:50.683428 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:50.683398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:51.407000 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:51.406962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:52.026186 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:52.026155    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:55.565789 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.565742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:55.637383 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.637354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:55.881539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.881499    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"]
Sep 17 01:43:55.885274 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.885254    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:55.887710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.887684    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:43:55.890019 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.889997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"]
Sep 17 01:43:55.915561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:55.915527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07942c61-86nlg\" (UID: \"6caa119c-227b-4522-94d0-c0d54b6f790b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:56.016328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.016293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07942c61-86nlg\" (UID: \"6caa119c-227b-4522-94d0-c0d54b6f790b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:56.017146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.017119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-07942c61-86nlg\" (UID: \"6caa119c-227b-4522-94d0-c0d54b6f790b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:56.198670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.198579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:56.476933 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.476902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"]
Sep 17 01:43:56.478831 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:43:56.478800    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6caa119c_227b_4522_94d0_c0d54b6f790b.slice/crio-4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c WatchSource:0}: Error finding container 4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c: Status 404 returned error can't find the container with id 4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c
Sep 17 01:43:56.485116 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.485092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:56.700247 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:56.700215    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:57.384387 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:57.384360    2573 generic.go:356] "Generic (PLEG): container finished" podID="6caa119c-227b-4522-94d0-c0d54b6f790b" containerID="6d7eebb778f5db93cfb14a9a25571572bb8bf2523feb1c3dcdbc46eebc060f65" exitCode=0
Sep 17 01:43:57.384520 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:57.384446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg" event={"ID":"6caa119c-227b-4522-94d0-c0d54b6f790b","Type":"ContainerDied","Data":"6d7eebb778f5db93cfb14a9a25571572bb8bf2523feb1c3dcdbc46eebc060f65"}
Sep 17 01:43:57.384520 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:57.384500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg" event={"ID":"6caa119c-227b-4522-94d0-c0d54b6f790b","Type":"ContainerStarted","Data":"4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c"}
Sep 17 01:43:57.595208 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:57.595094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:58.200103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.200057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:58.528028 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.528003    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:58.536043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.536019    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca\") pod \"6caa119c-227b-4522-94d0-c0d54b6f790b\" (UID: \"6caa119c-227b-4522-94d0-c0d54b6f790b\") "
Sep 17 01:43:58.536318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.536298    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6caa119c-227b-4522-94d0-c0d54b6f790b" (UID: "6caa119c-227b-4522-94d0-c0d54b6f790b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:43:58.637288 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.637253    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6caa119c-227b-4522-94d0-c0d54b6f790b-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:43:58.784882 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:58.784802    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:59.395513 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:59.395481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:43:59.396623 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:59.396602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg" event={"ID":"6caa119c-227b-4522-94d0-c0d54b6f790b","Type":"ContainerDied","Data":"4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c"}
Sep 17 01:43:59.396702 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:59.396634    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"
Sep 17 01:43:59.396702 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:59.396647    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4705162ff1664cc1be74fe9dc79165ada0f6f373a9d87ccf47d4dbc7d33a613c"
Sep 17 01:43:59.974063 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:43:59.974029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:00.115433 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:00.115381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.302748 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.302669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.329453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.329421    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:44:06.329678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.329652    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" podUID="46db52f5-0896-4351-b73b-22c0e1d8b966" containerName="payload-pre-processing" containerID="cri-o://6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766" gracePeriod=30
Sep 17 01:44:06.401098 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.401063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.479608 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.479514    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"]
Sep 17 01:44:06.481510 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.481472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.482923 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.482897    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-07942c61-86nlg"]
Sep 17 01:44:06.537106 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.537067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.588100 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.588071    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:44:06.601644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.601618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume\") pod \"46db52f5-0896-4351-b73b-22c0e1d8b966\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") "
Sep 17 01:44:06.601765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.601687    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bxpw\" (UniqueName: \"kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw\") pod \"46db52f5-0896-4351-b73b-22c0e1d8b966\" (UID: \"46db52f5-0896-4351-b73b-22c0e1d8b966\") "
Sep 17 01:44:06.601982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.601962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46db52f5-0896-4351-b73b-22c0e1d8b966" (UID: "46db52f5-0896-4351-b73b-22c0e1d8b966"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:06.603639 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.603622    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw" (OuterVolumeSpecName: "kube-api-access-6bxpw") pod "46db52f5-0896-4351-b73b-22c0e1d8b966" (UID: "46db52f5-0896-4351-b73b-22c0e1d8b966"). InnerVolumeSpecName "kube-api-access-6bxpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:06.702814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.702756    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46db52f5-0896-4351-b73b-22c0e1d8b966-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:06.702814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.702809    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bxpw\" (UniqueName: \"kubernetes.io/projected/46db52f5-0896-4351-b73b-22c0e1d8b966-kube-api-access-6bxpw\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:06.816399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.816319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:06.904129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:06.904098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:07.438023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.437988    2573 generic.go:356] "Generic (PLEG): container finished" podID="46db52f5-0896-4351-b73b-22c0e1d8b966" containerID="6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766" exitCode=0
Sep 17 01:44:07.438509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.438037    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"
Sep 17 01:44:07.438509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.438072    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" event={"ID":"46db52f5-0896-4351-b73b-22c0e1d8b966","Type":"ContainerDied","Data":"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"}
Sep 17 01:44:07.438509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.438155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj" event={"ID":"46db52f5-0896-4351-b73b-22c0e1d8b966","Type":"ContainerDied","Data":"e46640f8dcf99012831ddc9027d9f78ce47c03ab8ea0548c124179ae857b5689"}
Sep 17 01:44:07.438509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.438189    2573 scope.go:117] "RemoveContainer" containerID="6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"
Sep 17 01:44:07.455287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.455266    2573 scope.go:117] "RemoveContainer" containerID="6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"
Sep 17 01:44:07.455672 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:44:07.455646    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766\": container with ID starting with 6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766 not found: ID does not exist" containerID="6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"
Sep 17 01:44:07.455754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.455683    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766"} err="failed to get container status \"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766\": rpc error: code = NotFound desc = could not find container \"6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766\": container with ID starting with 6bcd2034243688368e236b237d28ac7d2e0afe28baf86c0fbbb6b173169e7766 not found: ID does not exist"
Sep 17 01:44:07.470710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.470683    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:44:07.474318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.474293    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj"]
Sep 17 01:44:07.594720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.594672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:07.799605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.799526    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46db52f5-0896-4351-b73b-22c0e1d8b966" path="/var/lib/kubelet/pods/46db52f5-0896-4351-b73b-22c0e1d8b966/volumes"
Sep 17 01:44:07.799914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:07.799899    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6caa119c-227b-4522-94d0-c0d54b6f790b" path="/var/lib/kubelet/pods/6caa119c-227b-4522-94d0-c0d54b6f790b/volumes"
Sep 17 01:44:08.289153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:08.289121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:08.380806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:08.380764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:44:09.110410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:09.110370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:09.689196 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:09.689165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:12.364449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:12.364414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:12.417153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:12.417123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:12.623102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:12.623027    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:12.939495 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:12.939418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:13.031936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:13.031908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:13.135690 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:13.135659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:18.844336 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:18.844303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:18.951937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:18.951906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:19.045130 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:19.045068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:19.156159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:19.156130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:24.387597 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:24.387554    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:44:24.406341 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:24.406311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:24.614589 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:24.614560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:25.323107 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:25.323074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:25.421149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:25.421116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:25.523529 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:25.523496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:25.881061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:25.881028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:26.285417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:26.285332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:26.582103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:26.582026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:26.693046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:26.693013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:26.793726 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:26.793696    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:27.464595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:27.464554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:28.194082 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:28.194054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:29.803399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:29.803369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:30.423502 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:30.423468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:30.703235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:30.703157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:30.797060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:30.797032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:31.378820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:31.378789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:32.012949 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:32.012912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:32.678310 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:32.678279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.388069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.388036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.489950 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.489917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.751333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.751256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.856280 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.856246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.931652 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.931615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:33.934888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.934862    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:44:33.935254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935240    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6caa119c-227b-4522-94d0-c0d54b6f790b" containerName="revoke-keys"
Sep 17 01:44:33.935304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935257    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6caa119c-227b-4522-94d0-c0d54b6f790b" containerName="revoke-keys"
Sep 17 01:44:33.935304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935270    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46db52f5-0896-4351-b73b-22c0e1d8b966" containerName="payload-pre-processing"
Sep 17 01:44:33.935304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935276    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46db52f5-0896-4351-b73b-22c0e1d8b966" containerName="payload-pre-processing"
Sep 17 01:44:33.935403 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935338    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6caa119c-227b-4522-94d0-c0d54b6f790b" containerName="revoke-keys"
Sep 17 01:44:33.935403 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.935348    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46db52f5-0896-4351-b73b-22c0e1d8b966" containerName="payload-pre-processing"
Sep 17 01:44:33.938361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.938341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:33.940621 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.940600    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-474b22\""
Sep 17 01:44:33.940933 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.940916    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-474b22-dockercfg-q7scn\""
Sep 17 01:44:33.947940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:33.947919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:44:34.043609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.043512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6cm\" (UniqueName: \"kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.043609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.043576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.145051 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.145000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6cm\" (UniqueName: \"kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.145224 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.145081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.146047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.146021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.153890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.153865    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6cm\" (UniqueName: \"kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm\") pod \"payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.182376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.182342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:34.249316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.249288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:34.524021 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.523995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:44:34.525766 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:44:34.525730    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c70820f_0397_412f_89c9_23d0f66ce3c6.slice/crio-2c3c31469cfcd007fb5cf831351d6babaf7a512b813e811d6a7e0676daabbb79 WatchSource:0}: Error finding container 2c3c31469cfcd007fb5cf831351d6babaf7a512b813e811d6a7e0676daabbb79: Status 404 returned error can't find the container with id 2c3c31469cfcd007fb5cf831351d6babaf7a512b813e811d6a7e0676daabbb79
Sep 17 01:44:34.583407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.583378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" event={"ID":"7c70820f-0397-412f-89c9-23d0f66ce3c6","Type":"ContainerStarted","Data":"2c3c31469cfcd007fb5cf831351d6babaf7a512b813e811d6a7e0676daabbb79"}
Sep 17 01:44:34.999255 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:34.999207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:35.590660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:35.590616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" event={"ID":"7c70820f-0397-412f-89c9-23d0f66ce3c6","Type":"ContainerStarted","Data":"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"}
Sep 17 01:44:35.590881 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:35.590762    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:35.607227 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:35.607178    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" podStartSLOduration=2.607166146 podStartE2EDuration="2.607166146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:44:35.605217496 +0000 UTC m=+1374.249325605" watchObservedRunningTime="2026-09-17 01:44:35.607166146 +0000 UTC m=+1374.251274226"
Sep 17 01:44:35.623048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:35.623020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:36.152100 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:36.152068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:36.395803 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:36.395753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.029348 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.029315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.061583 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.061548    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:44:37.061894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.061864    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" podUID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" containerName="payload-processing" containerID="cri-o://e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2" gracePeriod=30
Sep 17 01:44:37.130115 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.130079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.214573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.214542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.274839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.274759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.336617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.336577    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:44:37.470694 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.470657    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:44:37.479391 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.479360    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxfxc\" (UniqueName: \"kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc\") pod \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") "
Sep 17 01:44:37.479532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.479410    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume\") pod \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\" (UID: \"9b5be3e4-7478-4416-86db-7b46fa3dfaea\") "
Sep 17 01:44:37.479829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.479803    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b5be3e4-7478-4416-86db-7b46fa3dfaea" (UID: "9b5be3e4-7478-4416-86db-7b46fa3dfaea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:37.481369 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.481349    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc" (OuterVolumeSpecName: "kube-api-access-mxfxc") pod "9b5be3e4-7478-4416-86db-7b46fa3dfaea" (UID: "9b5be3e4-7478-4416-86db-7b46fa3dfaea"). InnerVolumeSpecName "kube-api-access-mxfxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:37.548419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.548384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:37.580808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.580682    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxfxc\" (UniqueName: \"kubernetes.io/projected/9b5be3e4-7478-4416-86db-7b46fa3dfaea-kube-api-access-mxfxc\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:37.580808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.580715    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b5be3e4-7478-4416-86db-7b46fa3dfaea-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:37.602002 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.601966    2573 generic.go:356] "Generic (PLEG): container finished" podID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" containerID="e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2" exitCode=0
Sep 17 01:44:37.602169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.602014    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"
Sep 17 01:44:37.602169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.602048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" event={"ID":"9b5be3e4-7478-4416-86db-7b46fa3dfaea","Type":"ContainerDied","Data":"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"}
Sep 17 01:44:37.602169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.602099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c" event={"ID":"9b5be3e4-7478-4416-86db-7b46fa3dfaea","Type":"ContainerDied","Data":"c869b61dccc22ad9aa6b177cc1ab542063423c4297f1ec20cb0ed0dcaeb4cc03"}
Sep 17 01:44:37.602169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.602123    2573 scope.go:117] "RemoveContainer" containerID="e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"
Sep 17 01:44:37.611820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.611797    2573 scope.go:117] "RemoveContainer" containerID="e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"
Sep 17 01:44:37.612077 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:44:37.612060    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2\": container with ID starting with e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2 not found: ID does not exist" containerID="e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"
Sep 17 01:44:37.612132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.612085    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2"} err="failed to get container status \"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2\": rpc error: code = NotFound desc = could not find container \"e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2\": container with ID starting with e2089784bfdf5a3bac366cc46bf03c2787d141499e5332528feffb82a56ebce2 not found: ID does not exist"
Sep 17 01:44:37.623089 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.623064    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:44:37.626471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.626438    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c"]
Sep 17 01:44:37.798977 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:37.798940    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" path="/var/lib/kubelet/pods/9b5be3e4-7478-4416-86db-7b46fa3dfaea/volumes"
Sep 17 01:44:38.077382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:38.077348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:38.894056 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:38.894026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:39.407981 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.407942    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" podUID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" containerName="main" containerID="cri-o://1ff1ee9ba82e6984f5f5521f00ab5d3790d2c39e48e964b578f40892ceb00dc3" gracePeriod=45
Sep 17 01:44:39.408762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.408734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:39.618721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.618691    2573 generic.go:356] "Generic (PLEG): container finished" podID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" containerID="1ff1ee9ba82e6984f5f5521f00ab5d3790d2c39e48e964b578f40892ceb00dc3" exitCode=0
Sep 17 01:44:39.618865 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.618744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" event={"ID":"20d775ba-bb73-472a-98cc-a1a17fc9c30c","Type":"ContainerDied","Data":"1ff1ee9ba82e6984f5f5521f00ab5d3790d2c39e48e964b578f40892ceb00dc3"}
Sep 17 01:44:39.662581 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.662527    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:44:39.801698 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801671    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.801903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801722    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.801903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801747    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9vbh\" (UniqueName: \"kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.801903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801761    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.801903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.801903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs\") pod \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\" (UID: \"20d775ba-bb73-472a-98cc-a1a17fc9c30c\") "
Sep 17 01:44:39.802188 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache" (OuterVolumeSpecName: "model-cache") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:44:39.802188 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.801970    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home" (OuterVolumeSpecName: "home") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:44:39.802188 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.802165    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:44:39.802541 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.802510    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tmp-dir\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:39.802639 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.802562    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-model-cache\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:39.802639 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.802579    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-home\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:39.804113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.804087    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh" (OuterVolumeSpecName: "kube-api-access-j9vbh") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "kube-api-access-j9vbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:39.804221 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.804211    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm" (OuterVolumeSpecName: "dshm") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:44:39.804283 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.804233    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20d775ba-bb73-472a-98cc-a1a17fc9c30c" (UID: "20d775ba-bb73-472a-98cc-a1a17fc9c30c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:44:39.903966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.903940    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20d775ba-bb73-472a-98cc-a1a17fc9c30c-tls-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:39.903966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.903964    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9vbh\" (UniqueName: \"kubernetes.io/projected/20d775ba-bb73-472a-98cc-a1a17fc9c30c-kube-api-access-j9vbh\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:39.904304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:39.903973    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20d775ba-bb73-472a-98cc-a1a17fc9c30c-dshm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:40.019397 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.019312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:40.626016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.625990    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"
Sep 17 01:44:40.626178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.626038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj" event={"ID":"20d775ba-bb73-472a-98cc-a1a17fc9c30c","Type":"ContainerDied","Data":"87bf1b4eb0d108bf44223abf8dc65777dfc217503a2eaea08b31600b19273e30"}
Sep 17 01:44:40.626178 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.626090    2573 scope.go:117] "RemoveContainer" containerID="1ff1ee9ba82e6984f5f5521f00ab5d3790d2c39e48e964b578f40892ceb00dc3"
Sep 17 01:44:40.647010 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.646983    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:44:40.650531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:40.650507    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d370b3/test-model-d370b3-kserve-7bbf8584f9-k8xdj"]
Sep 17 01:44:41.798867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:41.798834    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" path="/var/lib/kubelet/pods/20d775ba-bb73-472a-98cc-a1a17fc9c30c/volumes"
Sep 17 01:44:43.299930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.299895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:43.362573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.362534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:43.565239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.565161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:43.885844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.885810    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"]
Sep 17 01:44:43.886172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886156    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" containerName="main"
Sep 17 01:44:43.886172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886170    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" containerName="main"
Sep 17 01:44:43.886325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886187    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" containerName="payload-processing"
Sep 17 01:44:43.886325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886194    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" containerName="payload-processing"
Sep 17 01:44:43.886325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886251    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5be3e4-7478-4416-86db-7b46fa3dfaea" containerName="payload-processing"
Sep 17 01:44:43.886325 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.886261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d775ba-bb73-472a-98cc-a1a17fc9c30c" containerName="main"
Sep 17 01:44:43.890651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.890632    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:43.893157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.893131    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:44:43.896765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:43.896739    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"]
Sep 17 01:44:44.002607 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.002579    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:44.043755 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.043726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl\" (UID: \"31600326-bea6-4450-b8fc-43e03d0e1c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:44.144847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.144738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl\" (UID: \"31600326-bea6-4450-b8fc-43e03d0e1c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:44.145339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.145318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl\" (UID: \"31600326-bea6-4450-b8fc-43e03d0e1c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:44.203149 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.203120    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:44.472069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.472036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"]
Sep 17 01:44:44.473743 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:44:44.473710    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31600326_bea6_4450_b8fc_43e03d0e1c09.slice/crio-545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659 WatchSource:0}: Error finding container 545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659: Status 404 returned error can't find the container with id 545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659
Sep 17 01:44:44.647901 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.647859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl" event={"ID":"31600326-bea6-4450-b8fc-43e03d0e1c09","Type":"ContainerStarted","Data":"545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659"}
Sep 17 01:44:44.692304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:44.692272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:45.316214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:45.316163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:45.661109 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:45.661068    2573 generic.go:356] "Generic (PLEG): container finished" podID="31600326-bea6-4450-b8fc-43e03d0e1c09" containerID="984a6b24e0257fc9b6c9e415d0e4a9f42507bca168b483152e7c249ee2310eee" exitCode=0
Sep 17 01:44:45.661506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:45.661167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl" event={"ID":"31600326-bea6-4450-b8fc-43e03d0e1c09","Type":"ContainerDied","Data":"984a6b24e0257fc9b6c9e415d0e4a9f42507bca168b483152e7c249ee2310eee"}
Sep 17 01:44:46.035284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.035199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:46.135465 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.135425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:46.597466 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.597433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:44:46.807534 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.807510    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:46.884528 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.884495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:46.971999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.971958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca\") pod \"31600326-bea6-4450-b8fc-43e03d0e1c09\" (UID: \"31600326-bea6-4450-b8fc-43e03d0e1c09\") "
Sep 17 01:44:46.972298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:46.972277    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31600326-bea6-4450-b8fc-43e03d0e1c09" (UID: "31600326-bea6-4450-b8fc-43e03d0e1c09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:47.072897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:47.072866    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31600326-bea6-4450-b8fc-43e03d0e1c09-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:47.410973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:47.410931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:47.674156 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:47.674069    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"
Sep 17 01:44:47.674156 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:47.674084    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl" event={"ID":"31600326-bea6-4450-b8fc-43e03d0e1c09","Type":"ContainerDied","Data":"545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659"}
Sep 17 01:44:47.674156 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:47.674135    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="545cca132903192f4c3dbdf0a5c4702e525072a3553fb248b2c722fff609c659"
Sep 17 01:44:48.029648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:48.029576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:48.784043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:48.783988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:49.506934 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:49.506905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:50.220919 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.220887    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:50.340685 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.340652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:50.730067 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.730035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:50.960637 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.960601    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:44:50.961039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.961022    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31600326-bea6-4450-b8fc-43e03d0e1c09" containerName="revoke-keys"
Sep 17 01:44:50.961039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.961039    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="31600326-bea6-4450-b8fc-43e03d0e1c09" containerName="revoke-keys"
Sep 17 01:44:50.961191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.961103    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="31600326-bea6-4450-b8fc-43e03d0e1c09" containerName="revoke-keys"
Sep 17 01:44:50.964255 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.964234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:50.966766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.966742    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-725559-openshift-default-dockercfg-npcsq\""
Sep 17 01:44:50.979491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.979466    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:44:50.985207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:50.985156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:51.007713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwph2\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.007864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.007864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.007864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.007864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.007864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.008165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.008165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.007941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.008165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.008024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwph2\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108750 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.108966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.109167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.108995    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.109577 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.109540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.109695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.109588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.109741 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.109689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.109978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.109957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.111454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.111426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.111556 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.111521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.116278 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.116245    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.116415 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.116397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwph2\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2\") pod \"e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") " pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.274372 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.274289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:51.280269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.280247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:51.548571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.548538    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:44:51.549874 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:44:51.549842    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1c16e6_db92_467d_bd6e_17c2bc2a7073.slice/crio-1122145ce43577ff4c2f110991e09a5244e04bb52e16da7e2005f3f37aa60d08 WatchSource:0}: Error finding container 1122145ce43577ff4c2f110991e09a5244e04bb52e16da7e2005f3f37aa60d08: Status 404 returned error can't find the container with id 1122145ce43577ff4c2f110991e09a5244e04bb52e16da7e2005f3f37aa60d08
Sep 17 01:44:51.552185 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.552152    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:44:51.552289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.552218    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:44:51.552289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.552250    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:44:51.707163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.707121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerStarted","Data":"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"}
Sep 17 01:44:51.707344 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.707175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerStarted","Data":"1122145ce43577ff4c2f110991e09a5244e04bb52e16da7e2005f3f37aa60d08"}
Sep 17 01:44:51.725904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:51.725855    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podStartSLOduration=1.7258394799999999 podStartE2EDuration="1.72583948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:44:51.723694105 +0000 UTC m=+1390.367802204" watchObservedRunningTime="2026-09-17 01:44:51.72583948 +0000 UTC m=+1390.369947559"
Sep 17 01:44:52.274574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:52.274537    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:52.279354 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:52.279327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:52.713619 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:52.713586    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:52.714713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:52.714692    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:44:53.281569 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:53.281522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:53.577194 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:53.577106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:53.716610 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:53.716568    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:54.263087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:54.263041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:54.988121 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:54.988080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:55.548409 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.548379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:55.567573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.567541    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:44:55.567838 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.567794    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" podUID="294be512-1a0c-477f-ab24-04b7e15d04ab" containerName="payload-processing" containerID="cri-o://0870dfe86ba2ccefca85995de472503705d623a975550469ecdcc1272cb66fbf" gracePeriod=30
Sep 17 01:44:55.579181 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.579153    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:44:55.579682 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.579357    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" podUID="2789fdc9-3f71-4baa-b041-ea996f1bba21" containerName="payload-pre-processing" containerID="cri-o://69e6020b61c69ef3a776c39babc628cba87d2fd8b58fe01f671f58cf946b130c" gracePeriod=30
Sep 17 01:44:55.650540 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.650512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:55.731994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.731950    2573 generic.go:356] "Generic (PLEG): container finished" podID="294be512-1a0c-477f-ab24-04b7e15d04ab" containerID="0870dfe86ba2ccefca85995de472503705d623a975550469ecdcc1272cb66fbf" exitCode=0
Sep 17 01:44:55.732186 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.732089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" event={"ID":"294be512-1a0c-477f-ab24-04b7e15d04ab","Type":"ContainerDied","Data":"0870dfe86ba2ccefca85995de472503705d623a975550469ecdcc1272cb66fbf"}
Sep 17 01:44:55.733847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.733760    2573 generic.go:356] "Generic (PLEG): container finished" podID="2789fdc9-3f71-4baa-b041-ea996f1bba21" containerID="69e6020b61c69ef3a776c39babc628cba87d2fd8b58fe01f671f58cf946b130c" exitCode=0
Sep 17 01:44:55.733954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.733902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" event={"ID":"2789fdc9-3f71-4baa-b041-ea996f1bba21","Type":"ContainerDied","Data":"69e6020b61c69ef3a776c39babc628cba87d2fd8b58fe01f671f58cf946b130c"}
Sep 17 01:44:55.742878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.742836    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"]
Sep 17 01:44:55.749874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.749809    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:55.750012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.749970    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d370b3-5rzkl"]
Sep 17 01:44:55.811285 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.811210    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31600326-bea6-4450-b8fc-43e03d0e1c09" path="/var/lib/kubelet/pods/31600326-bea6-4450-b8fc-43e03d0e1c09/volumes"
Sep 17 01:44:55.831929 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.831893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:55.887568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.887546    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:44:55.890170 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.890152    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:44:55.951727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.951692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume\") pod \"294be512-1a0c-477f-ab24-04b7e15d04ab\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") "
Sep 17 01:44:55.951917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.951812    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stgf2\" (UniqueName: \"kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2\") pod \"2789fdc9-3f71-4baa-b041-ea996f1bba21\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") "
Sep 17 01:44:55.951917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.951857    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg5jh\" (UniqueName: \"kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh\") pod \"294be512-1a0c-477f-ab24-04b7e15d04ab\" (UID: \"294be512-1a0c-477f-ab24-04b7e15d04ab\") "
Sep 17 01:44:55.951917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.951899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume\") pod \"2789fdc9-3f71-4baa-b041-ea996f1bba21\" (UID: \"2789fdc9-3f71-4baa-b041-ea996f1bba21\") "
Sep 17 01:44:55.952113 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.952074    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "294be512-1a0c-477f-ab24-04b7e15d04ab" (UID: "294be512-1a0c-477f-ab24-04b7e15d04ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:55.952406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.952379    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2789fdc9-3f71-4baa-b041-ea996f1bba21" (UID: "2789fdc9-3f71-4baa-b041-ea996f1bba21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:55.954488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.954469    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2" (OuterVolumeSpecName: "kube-api-access-stgf2") pod "2789fdc9-3f71-4baa-b041-ea996f1bba21" (UID: "2789fdc9-3f71-4baa-b041-ea996f1bba21"). InnerVolumeSpecName "kube-api-access-stgf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:55.954569 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.954499    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh" (OuterVolumeSpecName: "kube-api-access-lg5jh") pod "294be512-1a0c-477f-ab24-04b7e15d04ab" (UID: "294be512-1a0c-477f-ab24-04b7e15d04ab"). InnerVolumeSpecName "kube-api-access-lg5jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:55.960060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:55.959943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:56.015407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.015372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:56.056422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.052704    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stgf2\" (UniqueName: \"kubernetes.io/projected/2789fdc9-3f71-4baa-b041-ea996f1bba21-kube-api-access-stgf2\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:56.056422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.052736    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg5jh\" (UniqueName: \"kubernetes.io/projected/294be512-1a0c-477f-ab24-04b7e15d04ab-kube-api-access-lg5jh\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:56.056422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.052753    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2789fdc9-3f71-4baa-b041-ea996f1bba21-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:56.056422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.052784    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/294be512-1a0c-477f-ab24-04b7e15d04ab-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:44:56.084327 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.084249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:56.502476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.502446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:56.598992 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.598963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:56.610172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610145    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:44:56.610505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610492    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2789fdc9-3f71-4baa-b041-ea996f1bba21" containerName="payload-pre-processing"
Sep 17 01:44:56.610505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610506    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2789fdc9-3f71-4baa-b041-ea996f1bba21" containerName="payload-pre-processing"
Sep 17 01:44:56.610588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610516    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294be512-1a0c-477f-ab24-04b7e15d04ab" containerName="payload-processing"
Sep 17 01:44:56.610588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610523    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="294be512-1a0c-477f-ab24-04b7e15d04ab" containerName="payload-processing"
Sep 17 01:44:56.610588 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610586    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="294be512-1a0c-477f-ab24-04b7e15d04ab" containerName="payload-processing"
Sep 17 01:44:56.610675 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.610596    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2789fdc9-3f71-4baa-b041-ea996f1bba21" containerName="payload-pre-processing"
Sep 17 01:44:56.613850 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.613832    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.616463 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.616441    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-725559\""
Sep 17 01:44:56.616463 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.616460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-725559-dockercfg-967x6\""
Sep 17 01:44:56.625619 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.625590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:44:56.640357 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.640328    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:44:56.644420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.644396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.652439 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.652416    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:44:56.658300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.658277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.658399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.658323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.658399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.658365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmrb\" (UniqueName: \"kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.658399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.658385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.742562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.742535    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"
Sep 17 01:44:56.742932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.742570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc" event={"ID":"294be512-1a0c-477f-ab24-04b7e15d04ab","Type":"ContainerDied","Data":"a0a927288c08fdca601bae22a332520f2ff648226df06d48f2a4139120fcef4e"}
Sep 17 01:44:56.743037 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.742973    2573 scope.go:117] "RemoveContainer" containerID="0870dfe86ba2ccefca85995de472503705d623a975550469ecdcc1272cb66fbf"
Sep 17 01:44:56.744613 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.744584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv" event={"ID":"2789fdc9-3f71-4baa-b041-ea996f1bba21","Type":"ContainerDied","Data":"f21136265dd3dc15cbeed87918f490c2f242de61d19368d650d13e9656d5cdb5"}
Sep 17 01:44:56.745921 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.744816    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"
Sep 17 01:44:56.759282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.759206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.759410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.759292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.759410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.759360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmrb\" (UniqueName: \"kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.759410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.759397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.760546 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.760214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.760546 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.760345    2573 scope.go:117] "RemoveContainer" containerID="69e6020b61c69ef3a776c39babc628cba87d2fd8b58fe01f671f58cf946b130c"
Sep 17 01:44:56.760546 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.760385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.767847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.767816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmrb\" (UniqueName: \"kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb\") pod \"payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.767847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.767834    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx\") pod \"payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.774321 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.774294    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:44:56.779223 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.779197    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc"]
Sep 17 01:44:56.795430 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.795407    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:44:56.799040 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.799012    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv"]
Sep 17 01:44:56.924549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.924510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:56.956419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.956388    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:56.981749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:56.981133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:57.199041 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.199018    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:44:57.200764 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:44:57.200740    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec48470b_dce6_4d34_8cb8_a5d96e80a307.slice/crio-2cf08343c36a55a6bb25249481b42fcb6883e6b3e2d80a98b2def6ac977d1340 WatchSource:0}: Error finding container 2cf08343c36a55a6bb25249481b42fcb6883e6b3e2d80a98b2def6ac977d1340: Status 404 returned error can't find the container with id 2cf08343c36a55a6bb25249481b42fcb6883e6b3e2d80a98b2def6ac977d1340
Sep 17 01:44:57.235754 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.235732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:44:57.238933 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:44:57.238903    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9b8cc7_defb_4d57_8c8a_ab6727786b34.slice/crio-74d3028c3d928b979040ceef9fbabe9627c784a575fa57b618a3460f3c9edf7d WatchSource:0}: Error finding container 74d3028c3d928b979040ceef9fbabe9627c784a575fa57b618a3460f3c9edf7d: Status 404 returned error can't find the container with id 74d3028c3d928b979040ceef9fbabe9627c784a575fa57b618a3460f3c9edf7d
Sep 17 01:44:57.603237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.603160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:57.752616 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.752581    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" event={"ID":"eb9b8cc7-defb-4d57-8c8a-ab6727786b34","Type":"ContainerStarted","Data":"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"}
Sep 17 01:44:57.752825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.752657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" event={"ID":"eb9b8cc7-defb-4d57-8c8a-ab6727786b34","Type":"ContainerStarted","Data":"74d3028c3d928b979040ceef9fbabe9627c784a575fa57b618a3460f3c9edf7d"}
Sep 17 01:44:57.752825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.752797    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:44:57.754408 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.754383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" event={"ID":"ec48470b-dce6-4d34-8cb8-a5d96e80a307","Type":"ContainerStarted","Data":"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"}
Sep 17 01:44:57.754537 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.754425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" event={"ID":"ec48470b-dce6-4d34-8cb8-a5d96e80a307","Type":"ContainerStarted","Data":"2cf08343c36a55a6bb25249481b42fcb6883e6b3e2d80a98b2def6ac977d1340"}
Sep 17 01:44:57.754537 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.754454    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:44:57.768004 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.767886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" podStartSLOduration=1.767866271 podStartE2EDuration="1.767866271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:44:57.767192 +0000 UTC m=+1396.411300103" watchObservedRunningTime="2026-09-17 01:44:57.767866271 +0000 UTC m=+1396.411974350"
Sep 17 01:44:57.793716 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.793666    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" podStartSLOduration=1.793652601 podStartE2EDuration="1.793652601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:44:57.791440606 +0000 UTC m=+1396.435548691" watchObservedRunningTime="2026-09-17 01:44:57.793652601 +0000 UTC m=+1396.437760679"
Sep 17 01:44:57.799319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.799290    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2789fdc9-3f71-4baa-b041-ea996f1bba21" path="/var/lib/kubelet/pods/2789fdc9-3f71-4baa-b041-ea996f1bba21/volumes"
Sep 17 01:44:57.799735 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:57.799716    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294be512-1a0c-477f-ab24-04b7e15d04ab" path="/var/lib/kubelet/pods/294be512-1a0c-477f-ab24-04b7e15d04ab/volumes"
Sep 17 01:44:58.326474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:58.326442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:59.100269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:59.100236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:59.200493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:59.200459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:44:59.802071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:44:59.802039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:00.134526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.134495    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"]
Sep 17 01:45:00.139214 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.139187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"
Sep 17 01:45:00.141081 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.141055    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"]
Sep 17 01:45:00.141499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.141482    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:45:00.145017 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.144974    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:00.145137 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.145087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"
Sep 17 01:45:00.149079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.148976    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"]
Sep 17 01:45:00.149710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.149355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"
Sep 17 01:45:00.153252 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.153227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"]
Sep 17 01:45:00.153354 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.153337    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"
Sep 17 01:45:00.154308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.154284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"]
Sep 17 01:45:00.154957 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.154871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"
Sep 17 01:45:00.157665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.157643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"]
Sep 17 01:45:00.168419 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.168400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"
Sep 17 01:45:00.175303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.175219    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:00.222618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.222594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"
Sep 17 01:45:00.235769 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.235729    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"
Sep 17 01:45:00.436539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.436513    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"]
Sep 17 01:45:00.438463 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:00.438432    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3115ad_c38b_4c9a_8fcb_5c2c9ce53844.slice/crio-ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4 WatchSource:0}: Error finding container ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4: Status 404 returned error can't find the container with id ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4
Sep 17 01:45:00.461238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.461214    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"]
Sep 17 01:45:00.472709 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:00.472681    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc7cfcc_8670_484d_a43f_79221bd8a33f.slice/crio-d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172 WatchSource:0}: Error finding container d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172: Status 404 returned error can't find the container with id d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172
Sep 17 01:45:00.528663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.528609    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"]
Sep 17 01:45:00.530172 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:00.530144    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd41c35_46f0_4ccc_89c0_d1a27a5de639.slice/crio-4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf WatchSource:0}: Error finding container 4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf: Status 404 returned error can't find the container with id 4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf
Sep 17 01:45:00.530931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.530910    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:00.533665 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:00.533645    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eac325e_e70c_47d3_ade8_8d99ef70675f.slice/crio-da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2 WatchSource:0}: Error finding container da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2: Status 404 returned error can't find the container with id da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2
Sep 17 01:45:00.774187 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.774154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerStarted","Data":"da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2"}
Sep 17 01:45:00.775762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.775737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx" event={"ID":"3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844","Type":"ContainerStarted","Data":"bfd365f68ae350563f6341779b0ade46d3f33a54df020168fab594986ac7e9b0"}
Sep 17 01:45:00.775878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.775814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx" event={"ID":"3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844","Type":"ContainerStarted","Data":"ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4"}
Sep 17 01:45:00.776982 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.776959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz" event={"ID":"7bd41c35-46f0-4ccc-89c0-d1a27a5de639","Type":"ContainerStarted","Data":"4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf"}
Sep 17 01:45:00.778372 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.778342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn" event={"ID":"0dc7cfcc-8670-484d-a43f-79221bd8a33f","Type":"ContainerStarted","Data":"456e88078fdcbe417b6a6e2e3558281c587d66f66afa22c9194e0fe5229e35a1"}
Sep 17 01:45:00.778456 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.778394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn" event={"ID":"0dc7cfcc-8670-484d-a43f-79221bd8a33f","Type":"ContainerStarted","Data":"d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172"}
Sep 17 01:45:00.792930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.792881    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx" podStartSLOduration=0.792866527 podStartE2EDuration="792.866527ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:00.79207212 +0000 UTC m=+1399.436180222" watchObservedRunningTime="2026-09-17 01:45:00.792866527 +0000 UTC m=+1399.436974606"
Sep 17 01:45:00.807484 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:00.807447    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn" podStartSLOduration=0.807434788 podStartE2EDuration="807.434788ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:00.806760725 +0000 UTC m=+1399.450868821" watchObservedRunningTime="2026-09-17 01:45:00.807434788 +0000 UTC m=+1399.451542888"
Sep 17 01:45:01.654457 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.654424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:01.785085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.785005    2573 generic.go:356] "Generic (PLEG): container finished" podID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerID="92f8b12aa22533701818dadaaf4c57efc5ac19ce4e113b048ebf49417e8f5987" exitCode=7
Sep 17 01:45:01.785085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.785066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerDied","Data":"92f8b12aa22533701818dadaaf4c57efc5ac19ce4e113b048ebf49417e8f5987"}
Sep 17 01:45:01.785310 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.785294    2573 scope.go:117] "RemoveContainer" containerID="92f8b12aa22533701818dadaaf4c57efc5ac19ce4e113b048ebf49417e8f5987"
Sep 17 01:45:01.786787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.786756    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844" containerID="bfd365f68ae350563f6341779b0ade46d3f33a54df020168fab594986ac7e9b0" exitCode=0
Sep 17 01:45:01.786882 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.786838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx" event={"ID":"3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844","Type":"ContainerDied","Data":"bfd365f68ae350563f6341779b0ade46d3f33a54df020168fab594986ac7e9b0"}
Sep 17 01:45:01.788553 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.788527    2573 generic.go:356] "Generic (PLEG): container finished" podID="7bd41c35-46f0-4ccc-89c0-d1a27a5de639" containerID="5cee50a379d4016c8304b324d62e0ef6acecc31b022a0cf5bfc04fcd7e73f0f7" exitCode=0
Sep 17 01:45:01.788637 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.788602    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz" event={"ID":"7bd41c35-46f0-4ccc-89c0-d1a27a5de639","Type":"ContainerDied","Data":"5cee50a379d4016c8304b324d62e0ef6acecc31b022a0cf5bfc04fcd7e73f0f7"}
Sep 17 01:45:01.790216 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.790198    2573 generic.go:356] "Generic (PLEG): container finished" podID="0dc7cfcc-8670-484d-a43f-79221bd8a33f" containerID="456e88078fdcbe417b6a6e2e3558281c587d66f66afa22c9194e0fe5229e35a1" exitCode=0
Sep 17 01:45:01.790289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.790229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn" event={"ID":"0dc7cfcc-8670-484d-a43f-79221bd8a33f","Type":"ContainerDied","Data":"456e88078fdcbe417b6a6e2e3558281c587d66f66afa22c9194e0fe5229e35a1"}
Sep 17 01:45:01.804800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.804758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:01.876849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.876817    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:45:01.877199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.877036    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" containerID="cri-o://073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb" gracePeriod=30
Sep 17 01:45:01.899127 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:01.899097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:02.423368 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.423291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:02.655674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.655641    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:45:02.659228 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.659206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.661677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.661651    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-fcd402-openshift-default-dockercfg-v8lhd\""
Sep 17 01:45:02.670267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.670242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:45:02.687144 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.687078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:02.718258 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718233    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nns89\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.718640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.718611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.799570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.799540    2573 generic.go:356] "Generic (PLEG): container finished" podID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerID="85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06" exitCode=7
Sep 17 01:45:02.799764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.799626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerDied","Data":"85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06"}
Sep 17 01:45:02.799764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.799667    2573 scope.go:117] "RemoveContainer" containerID="92f8b12aa22533701818dadaaf4c57efc5ac19ce4e113b048ebf49417e8f5987"
Sep 17 01:45:02.799892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.799820    2573 scope.go:117] "RemoveContainer" containerID="85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06"
Sep 17 01:45:02.800488 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:45:02.800090    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699_odh-ai-gateway-infra(6eac325e-e70c-47d3-ade8-8d99ef70675f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f"
Sep 17 01:45:02.819368 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nns89\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819717 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819717 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819717 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819717 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.819717 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.820060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.819754    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.820060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.820037    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.820060 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.820050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.820313 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.820284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.821205 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.821177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.822605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.822577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.823361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.823331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.828580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.828531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nns89\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.828880 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.828854    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token\") pod \"e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") " pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.934955 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.934928    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"
Sep 17 01:45:02.971318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.971286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:02.975805 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:02.975706    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"
Sep 17 01:45:03.000048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.000004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"
Sep 17 01:45:03.263719 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.263687    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:45:03.265180 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:03.265151    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecc7d6b_845a_4f39_b3ec_e992c9d1064c.slice/crio-3cc1f0002b65d8f57ff82cb16bae5f397493baa7fed4404103b0cda25a2a027a WatchSource:0}: Error finding container 3cc1f0002b65d8f57ff82cb16bae5f397493baa7fed4404103b0cda25a2a027a: Status 404 returned error can't find the container with id 3cc1f0002b65d8f57ff82cb16bae5f397493baa7fed4404103b0cda25a2a027a
Sep 17 01:45:03.267506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.267471    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:03.267600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.267548    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:03.267600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.267593    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:03.410727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.410682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:03.805881 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.805850    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"
Sep 17 01:45:03.805881 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.805861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx" event={"ID":"3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844","Type":"ContainerDied","Data":"ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4"}
Sep 17 01:45:03.806142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.805918    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceb8f2a2fdcb8f98a65af24b51a355899857fb1a3711f7b0ab84d6cc9c7fecc4"
Sep 17 01:45:03.807452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.807428    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"
Sep 17 01:45:03.807452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.807438    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz" event={"ID":"7bd41c35-46f0-4ccc-89c0-d1a27a5de639","Type":"ContainerDied","Data":"4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf"}
Sep 17 01:45:03.807648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.807484    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad9c8c18d40a4ce8f85de8629cb67d8d0e60c7220b947984278c3b92de809bf"
Sep 17 01:45:03.811358 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.811329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn" event={"ID":"0dc7cfcc-8670-484d-a43f-79221bd8a33f","Type":"ContainerDied","Data":"d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172"}
Sep 17 01:45:03.811468 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.811376    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d44c984cc422b81155b69744c8c0d3ad310df1fdbcc35c997b09c69e15fb7172"
Sep 17 01:45:03.811468 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.811431    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"
Sep 17 01:45:03.813749 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.813726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerStarted","Data":"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"}
Sep 17 01:45:03.813876 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.813807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerStarted","Data":"3cc1f0002b65d8f57ff82cb16bae5f397493baa7fed4404103b0cda25a2a027a"}
Sep 17 01:45:03.815863 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.815845    2573 scope.go:117] "RemoveContainer" containerID="85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06"
Sep 17 01:45:03.816057 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:45:03.816039    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699_odh-ai-gateway-infra(6eac325e-e70c-47d3-ade8-8d99ef70675f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f"
Sep 17 01:45:03.834166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.834124    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podStartSLOduration=1.834110822 podStartE2EDuration="1.834110822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:03.832495206 +0000 UTC m=+1402.476603305" watchObservedRunningTime="2026-09-17 01:45:03.834110822 +0000 UTC m=+1402.478218901"
Sep 17 01:45:03.971887 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:03.971859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:04.976464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:04.976433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:05.093793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:05.093745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:05.798628 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:05.798596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:05.828580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:05.828546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:05.829571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:05.829554    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:05.896973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:05.896942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:06.372216 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:06.372174    2573 patch_prober.go:28] interesting pod/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:45:06.372587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:06.372242    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:45:06.481986 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:06.481956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:07.135077 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.135052    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:45:07.210878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.210785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:07.265967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.265935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.265989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266079    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266113    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266134    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266237    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prx22\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266330    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy\") pod \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\" (UID: \"ee12ff34-c31b-4fbc-999a-3416df3fe3cc\") "
Sep 17 01:45:07.266548 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266345    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:45:07.266548 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266410    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:45:07.266657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266570    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:45:07.266657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266593    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:45:07.266758 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266741    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.266842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266761    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.266842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266794    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.266842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266802    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:45:07.266842 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.266810    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.268182 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.268151    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:45:07.268433 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.268393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22" (OuterVolumeSpecName: "kube-api-access-prx22") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "kube-api-access-prx22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:45:07.268792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.268759    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:45:07.268839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.268796    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee12ff34-c31b-4fbc-999a-3416df3fe3cc" (UID: "ee12ff34-c31b-4fbc-999a-3416df3fe3cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:45:07.367442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.367406    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prx22\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-kube-api-access-prx22\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.367442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.367438    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.367442 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.367447    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.367663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.367457    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.367663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.367464    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee12ff34-c31b-4fbc-999a-3416df3fe3cc-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:45:07.841340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.841305    2573 generic.go:356] "Generic (PLEG): container finished" podID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerID="073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb" exitCode=0
Sep 17 01:45:07.841763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.841361    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"
Sep 17 01:45:07.841763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.841391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerDied","Data":"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"}
Sep 17 01:45:07.841763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.841445    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql" event={"ID":"ee12ff34-c31b-4fbc-999a-3416df3fe3cc","Type":"ContainerDied","Data":"f9782efa9f2c4a9d5584b9ebb53530f54c006fbc494cc1c07c78864260410098"}
Sep 17 01:45:07.841763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.841467    2573 scope.go:117] "RemoveContainer" containerID="073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"
Sep 17 01:45:07.851683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.851666    2573 scope.go:117] "RemoveContainer" containerID="92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"
Sep 17 01:45:07.860399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.860377    2573 scope.go:117] "RemoveContainer" containerID="073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"
Sep 17 01:45:07.860709 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:45:07.860683    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb\": container with ID starting with 073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb not found: ID does not exist" containerID="073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"
Sep 17 01:45:07.860810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.860722    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb"} err="failed to get container status \"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb\": rpc error: code = NotFound desc = could not find container \"073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb\": container with ID starting with 073dbe31f5ae3aea71eee0f087b0a419801b7df55cb67e81cb41659d5c0eb7fb not found: ID does not exist"
Sep 17 01:45:07.860810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.860749    2573 scope.go:117] "RemoveContainer" containerID="92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"
Sep 17 01:45:07.861093 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:45:07.861071    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1\": container with ID starting with 92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1 not found: ID does not exist" containerID="92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"
Sep 17 01:45:07.861189 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.861096    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1"} err="failed to get container status \"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1\": rpc error: code = NotFound desc = could not find container \"92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1\": container with ID starting with 92c5af0ea445e26d7963d0f07079a0d6c519da46f1116ee7de4efec4fddd05d1 not found: ID does not exist"
Sep 17 01:45:07.862079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.862059    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:45:07.868023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.868001    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql"]
Sep 17 01:45:07.886491 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:07.886465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:08.257155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:08.257114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:08.531447 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:08.531363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:08.763562 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:08.763532    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:45:08.763718 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:08.763605    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:45:09.170663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.170636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:09.270887 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.270852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:09.611163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.611137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:09.709728 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.709697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:09.722090 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722064    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:45:09.722478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722462    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722480    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722489    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc7cfcc-8670-484d-a43f-79221bd8a33f" containerName="cleanup"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722495    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc7cfcc-8670-484d-a43f-79221bd8a33f" containerName="cleanup"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722508    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722513    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722522    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd41c35-46f0-4ccc-89c0-d1a27a5de639" containerName="cleanup"
Sep 17 01:45:09.722527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722528    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd41c35-46f0-4ccc-89c0-d1a27a5de639" containerName="cleanup"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722540    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844" containerName="cleanup"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722545    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844" containerName="cleanup"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722599    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd41c35-46f0-4ccc-89c0-d1a27a5de639" containerName="cleanup"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722607    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722613    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc7cfcc-8670-484d-a43f-79221bd8a33f" containerName="cleanup"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722620    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" containerName="istio-proxy"
Sep 17 01:45:09.722744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.722625    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844" containerName="cleanup"
Sep 17 01:45:09.727287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.727271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.729618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.729598    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-fcd402-dockercfg-z9fvq\""
Sep 17 01:45:09.729746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.729668    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-fcd402\""
Sep 17 01:45:09.733661 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.733641    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:45:09.752936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.752913    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:45:09.756415 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.756400    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.773242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.773222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:45:09.788655 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.788632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tlts\" (UniqueName: \"kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.788757 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.788742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.798472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.798447    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee12ff34-c31b-4fbc-999a-3416df3fe3cc" path="/var/lib/kubelet/pods/ee12ff34-c31b-4fbc-999a-3416df3fe3cc/volumes"
Sep 17 01:45:09.819801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.819111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:09.889679 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.889593    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tlts\" (UniqueName: \"kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.889877 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.889690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.889877 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.889725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tffx\" (UniqueName: \"kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.890011 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.889896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.890535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.890518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.904760 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.904735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tlts\" (UniqueName: \"kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts\") pod \"payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:09.990568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.990533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.990743 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.990582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tffx\" (UniqueName: \"kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.991525 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.991499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:09.997954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:09.997934    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tffx\" (UniqueName: \"kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx\") pod \"payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:10.038806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.038751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:10.066949 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.066914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:10.097904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.097812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:10.317677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.317652    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:45:10.319383 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:10.319360    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4069dc_66bc_4680_85c7_be7cdbe4b3fa.slice/crio-0949e43a0b117958bc905837162e254be557cdad556ccfb6331d99ddc906a090 WatchSource:0}: Error finding container 0949e43a0b117958bc905837162e254be557cdad556ccfb6331d99ddc906a090: Status 404 returned error can't find the container with id 0949e43a0b117958bc905837162e254be557cdad556ccfb6331d99ddc906a090
Sep 17 01:45:10.353637 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.353612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:45:10.354855 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:10.354827    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf39b2b5_0444_45d7_a8ae_0eb4f4db69ad.slice/crio-ee3d797fad0b9e26bab32d70de3db3936f718637fdd9e215704ec44deb654cb9 WatchSource:0}: Error finding container ee3d797fad0b9e26bab32d70de3db3936f718637fdd9e215704ec44deb654cb9: Status 404 returned error can't find the container with id ee3d797fad0b9e26bab32d70de3db3936f718637fdd9e215704ec44deb654cb9
Sep 17 01:45:10.774111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.774061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:45:10.861960 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.861928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" event={"ID":"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa","Type":"ContainerStarted","Data":"7112eb57dc948d96cb786ebf6a4380bea5735fc358c92f7e6e732fb89f8352de"}
Sep 17 01:45:10.862146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.861980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" event={"ID":"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa","Type":"ContainerStarted","Data":"0949e43a0b117958bc905837162e254be557cdad556ccfb6331d99ddc906a090"}
Sep 17 01:45:10.862146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.862025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:10.863670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.863644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" event={"ID":"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad","Type":"ContainerStarted","Data":"485128b478a3da82c19fc7d8148097668c32254e48dbe0f9291dbeea3a8b41fc"}
Sep 17 01:45:10.863831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.863682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" event={"ID":"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad","Type":"ContainerStarted","Data":"ee3d797fad0b9e26bab32d70de3db3936f718637fdd9e215704ec44deb654cb9"}
Sep 17 01:45:10.863831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.863797    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:10.879204 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.879159    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" podStartSLOduration=1.879146319 podStartE2EDuration="1.879146319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:10.877934278 +0000 UTC m=+1409.522042379" watchObservedRunningTime="2026-09-17 01:45:10.879146319 +0000 UTC m=+1409.523254398"
Sep 17 01:45:10.886136 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.886113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:10.895713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:10.895662    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" podStartSLOduration=1.895650907 podStartE2EDuration="1.895650907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:10.894090508 +0000 UTC m=+1409.538198599" watchObservedRunningTime="2026-09-17 01:45:10.895650907 +0000 UTC m=+1409.539758982"
Sep 17 01:45:11.620061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:11.620002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:12.237016 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:12.236983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:12.940021 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:12.939988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:14.792918 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:14.792884    2573 scope.go:117] "RemoveContainer" containerID="85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06"
Sep 17 01:45:15.897223 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:15.897185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerStarted","Data":"0a882b4c2dc7930efcf0d914c84ec312feb5c7b33095fd183bb37c49053f3c79"}
Sep 17 01:45:15.911649 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:15.911577    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" podStartSLOduration=15.911555735 podStartE2EDuration="15.911555735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:15.910605272 +0000 UTC m=+1414.554713383" watchObservedRunningTime="2026-09-17 01:45:15.911555735 +0000 UTC m=+1414.555663811"
Sep 17 01:45:16.905473 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:16.905434    2573 generic.go:356] "Generic (PLEG): container finished" podID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerID="0a882b4c2dc7930efcf0d914c84ec312feb5c7b33095fd183bb37c49053f3c79" exitCode=0
Sep 17 01:45:16.905875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:16.905507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerDied","Data":"0a882b4c2dc7930efcf0d914c84ec312feb5c7b33095fd183bb37c49053f3c79"}
Sep 17 01:45:16.905875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:16.905572    2573 scope.go:117] "RemoveContainer" containerID="85506434ab474a5339246193625b3fa10ce03d2267e6fdcabd4694f03915ff06"
Sep 17 01:45:16.922262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:16.922235    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:17.026524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.026476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:17.125147 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.125113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:17.393119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.393085    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:45:17.398547 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.398521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.398926 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.398899    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:45:17.401379 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.401353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2a1db100-openshift-default-dockercfg-gf86z\""
Sep 17 01:45:17.407119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.407093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:17.470576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470794 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.470994 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.470939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.471159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.471019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wp6\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.471159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.471115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.556922 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.556888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:17.572236 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572236 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wp6\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.572891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.573070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.573044    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.573070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.572881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.573218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.573195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.574594 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.574577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.574828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.574811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.580323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.580296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wp6\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.580443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.580422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token\") pod \"e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") " pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:17.738308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:17.738219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:18.022829 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.016108    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:45:18.047454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.047387    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:18.047568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.047487    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:18.047568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.047521    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:18.090378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.090349    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"
Sep 17 01:45:18.944262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.944222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerStarted","Data":"1ad618a663790a9924aed59b8711a071ba04e06a1baa274fd3b1d3322b6bc863"}
Sep 17 01:45:18.944435 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.944289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerStarted","Data":"b7d786baba6746e4c72dcc21b83e4c06514e17a011cc0542fa802e23c0e4e3d4"}
Sep 17 01:45:18.945705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.945673    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"
Sep 17 01:45:18.945836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.945704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699" event={"ID":"6eac325e-e70c-47d3-ade8-8d99ef70675f","Type":"ContainerDied","Data":"da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2"}
Sep 17 01:45:18.945836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.945742    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da6c251ef226c60b5d988b4e357afafabd348896b67785a7e4df2c48ef6b90a2"
Sep 17 01:45:18.965239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.965189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podStartSLOduration=1.9651754000000001 podStartE2EDuration="1.9651754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:18.963104434 +0000 UTC m=+1417.607212550" watchObservedRunningTime="2026-09-17 01:45:18.9651754 +0000 UTC m=+1417.609283479"
Sep 17 01:45:18.985996 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.985973    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:18.989215 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:18.989180    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-725559-29826825-4w699"]
Sep 17 01:45:19.738533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:19.738497    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:19.744969 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:19.744941    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:19.800844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:19.800807    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" path="/var/lib/kubelet/pods/6eac325e-e70c-47d3-ade8-8d99ef70675f/volumes"
Sep 17 01:45:19.951566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:19.951534    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:19.952604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:19.952582    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:20.207074 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:20.207043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:20.825331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:20.825285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:20.917196 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:20.917163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:21.189023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.188989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:21.802392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.802353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:21.876110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.876087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:45:21.876422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.876157    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:45:21.963854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.963758    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerID="463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13" exitCode=0
Sep 17 01:45:21.963854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.963813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerDied","Data":"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"}
Sep 17 01:45:21.964287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.964269    2573 scope.go:117] "RemoveContainer" containerID="463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"
Sep 17 01:45:21.965387 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.965347    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:21.965489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.965430    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:21.965489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:21.965481    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:22.696741 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:22.696704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:22.713676 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:22.713649    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:45:22.971207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:22.971110    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerStarted","Data":"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"}
Sep 17 01:45:23.274762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:23.274670    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:45:23.276035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:23.276007    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 17 01:45:23.276176 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:23.276067    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 17 01:45:23.578873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:23.578762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:24.275540 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:24.275504    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 17 01:45:24.275940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:24.275574    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 17 01:45:24.305169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:24.305143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:25.200352 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:25.200320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:25.275095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:25.275057    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 17 01:45:25.275365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:25.275331    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 17 01:45:25.575634 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:25.575531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:25.890998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:25.890967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.117791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.117724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.190736 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.190663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.248692 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.248662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.274978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.274947    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 17 01:45:26.275126 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.274997    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 17 01:45:26.349078 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.349021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.449710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.449631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.742429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.742335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.876431 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.876396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:26.885429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885400    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:45:26.885823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885810    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.885875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885825    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.885875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885836    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.885875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885842    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.885875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885853    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.885875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885858    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.886031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885913    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.886031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.885920    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:26.888760 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.888741    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:26.891358 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.891336    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2a1db100\""
Sep 17 01:45:26.891358 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.891347    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2a1db100-dockercfg-trb9p\""
Sep 17 01:45:26.899531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:26.899501    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:45:27.070430 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.070330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsnnr\" (UniqueName: \"kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.070601 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.070520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.171976 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.171938    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.172287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.172259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsnnr\" (UniqueName: \"kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.172980 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.172938    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.181122 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.181094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsnnr\" (UniqueName: \"kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr\") pod \"payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") " pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.200697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.200664    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:27.275523 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.275485    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 17 01:45:27.275716 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.275537    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 17 01:45:27.343261 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.343183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:27.506290 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:27.506255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:45:28.005456 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.005417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" event={"ID":"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac","Type":"ContainerStarted","Data":"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"}
Sep 17 01:45:28.005891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.005475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" event={"ID":"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac","Type":"ContainerStarted","Data":"835e82b1550700f109d13558bb60f65f4592763dc77bbdc452f0c86ab20bc23a"}
Sep 17 01:45:28.005891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.005589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:28.022935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.022879    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" podStartSLOduration=2.02286378 podStartE2EDuration="2.02286378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:28.020656646 +0000 UTC m=+1426.664764750" watchObservedRunningTime="2026-09-17 01:45:28.02286378 +0000 UTC m=+1426.666971859"
Sep 17 01:45:28.279670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.279596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:45:28.280015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.279992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:45:28.280611 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.280589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:45:28.293519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.293493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:28.908129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:28.908084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:29.009493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:29.009456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:29.109452 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:29.109413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:29.690874 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:29.690841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:30.583001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:30.582966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:31.308108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:31.308077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:31.923190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:31.923149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:32.702931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:32.702900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:33.371035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:33.370994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.159002 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.158922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.206574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.206541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.340618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.340576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.395353 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.395321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.678537 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.678500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:34.918352 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:34.918321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:35.019508 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.019424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:35.023798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.020013    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:45:35.023798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.020710    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eac325e-e70c-47d3-ade8-8d99ef70675f" containerName="cleanup"
Sep 17 01:45:35.029677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.029653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.033658 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.033590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:45:35.035550 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.035531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-361849-dockercfg-fkr29\""
Sep 17 01:45:35.045793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.042466    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-361849\""
Sep 17 01:45:35.052292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.052254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2lsj\" (UniqueName: \"kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.052427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.052347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.055079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.055054    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:45:35.058387 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.058366    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.066665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.066647    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:45:35.154800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.154652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52jj\" (UniqueName: \"kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.154800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.154734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.154800 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.154793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.155118 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.154896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2lsj\" (UniqueName: \"kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.156140 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.156103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.164940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.164904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2lsj\" (UniqueName: \"kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj\") pod \"payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.255395 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.255353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52jj\" (UniqueName: \"kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.255567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.255425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.256094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.256073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.262762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.262736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52jj\" (UniqueName: \"kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj\") pod \"payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.358947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.358913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:35.371025 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.370997    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:35.659460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.659375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:45:35.662035 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:35.662005    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1604d921_510d_4525_9266_8a56a8a4f980.slice/crio-a5c6a7710ec711b04dbda85312e335e25c43bb5b8d0fdf3192bd1c770a218652 WatchSource:0}: Error finding container a5c6a7710ec711b04dbda85312e335e25c43bb5b8d0fdf3192bd1c770a218652: Status 404 returned error can't find the container with id a5c6a7710ec711b04dbda85312e335e25c43bb5b8d0fdf3192bd1c770a218652
Sep 17 01:45:35.679443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:35.679418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:45:35.682185 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:45:35.682162    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2706e0_8295_49f3_97e6_433dc52d77cd.slice/crio-d456b1d8075a5d7594d53895af5c03ea7fe578a83f721d3357b0b4b64c56f8f9 WatchSource:0}: Error finding container d456b1d8075a5d7594d53895af5c03ea7fe578a83f721d3357b0b4b64c56f8f9: Status 404 returned error can't find the container with id d456b1d8075a5d7594d53895af5c03ea7fe578a83f721d3357b0b4b64c56f8f9
Sep 17 01:45:36.063001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.062908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" event={"ID":"1604d921-510d-4525-9266-8a56a8a4f980","Type":"ContainerStarted","Data":"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"}
Sep 17 01:45:36.063001 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.062964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" event={"ID":"1604d921-510d-4525-9266-8a56a8a4f980","Type":"ContainerStarted","Data":"a5c6a7710ec711b04dbda85312e335e25c43bb5b8d0fdf3192bd1c770a218652"}
Sep 17 01:45:36.063231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.063034    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:36.065013 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.064991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" event={"ID":"dc2706e0-8295-49f3-97e6-433dc52d77cd","Type":"ContainerStarted","Data":"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"}
Sep 17 01:45:36.065163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.065029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" event={"ID":"dc2706e0-8295-49f3-97e6-433dc52d77cd","Type":"ContainerStarted","Data":"d456b1d8075a5d7594d53895af5c03ea7fe578a83f721d3357b0b4b64c56f8f9"}
Sep 17 01:45:36.065163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.065082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:36.079615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.079576    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" podStartSLOduration=2.079562549 podStartE2EDuration="2.079562549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:36.078256034 +0000 UTC m=+1434.722364162" watchObservedRunningTime="2026-09-17 01:45:36.079562549 +0000 UTC m=+1434.723670640"
Sep 17 01:45:36.092231 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:36.092189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" podStartSLOduration=1.092175955 podStartE2EDuration="1.092175955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:45:36.091858215 +0000 UTC m=+1434.735966316" watchObservedRunningTime="2026-09-17 01:45:36.092175955 +0000 UTC m=+1434.736284033"
Sep 17 01:45:39.013966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:39.013932    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:45:41.100848 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.100813    2573 generic.go:356] "Generic (PLEG): container finished" podID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerID="bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592" exitCode=0
Sep 17 01:45:41.101292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.100867    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerDied","Data":"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"}
Sep 17 01:45:41.101292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.101247    2573 scope.go:117] "RemoveContainer" containerID="bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"
Sep 17 01:45:41.102427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.102391    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:41.102515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.102467    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:41.102515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:41.102497    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:42.134333 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:42.134289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerStarted","Data":"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"}
Sep 17 01:45:42.972095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:42.972058    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:42.972283 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:42.972259    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 17 01:45:42.972338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:42.972309    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 17 01:45:43.971944 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:43.971908    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 17 01:45:43.972332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:43.971974    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 17 01:45:44.972399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:44.972360    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 17 01:45:44.972922 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:44.972435    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 17 01:45:45.971964 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:45.971926    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 17 01:45:45.972152 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:45.971986    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 17 01:45:46.176485 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:46.176447    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:45:46.972622 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:46.972582    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 17 01:45:46.972837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:46.972644    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 17 01:45:47.076128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.076097    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:45:47.076315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.076175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:45:47.936332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.936203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:47.976256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.976228    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:47.976624 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.976598    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:47.977354 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:47.977334    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:45:49.077144 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:49.077107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:49.785966 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:49.785929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:50.695600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:50.695567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:50.827339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:50.827304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:51.475511 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:51.475463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:52.195573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:52.195542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:52.966527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:52.966495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:53.604791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:53.604737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:53.835172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:53.835137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:54.306239 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:54.306202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:54.918482 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:54.918444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:55.670314 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:55.670280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:56.222213 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.222184    2573 generic.go:356] "Generic (PLEG): container finished" podID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerID="1ad618a663790a9924aed59b8711a071ba04e06a1baa274fd3b1d3322b6bc863" exitCode=0
Sep 17 01:45:56.222559 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.222256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerDied","Data":"1ad618a663790a9924aed59b8711a071ba04e06a1baa274fd3b1d3322b6bc863"}
Sep 17 01:45:56.222733 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.222714    2573 scope.go:117] "RemoveContainer" containerID="1ad618a663790a9924aed59b8711a071ba04e06a1baa274fd3b1d3322b6bc863"
Sep 17 01:45:56.223954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.223928    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:56.224026 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.224011    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:56.224065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.224045    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 01:45:56.403838 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:56.403754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:57.085278 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.085235    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:57.233641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.233605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerStarted","Data":"be0456a2889a9806a98187176143e72deb7b9d1aa9a302641fe98809442dd6b2"}
Sep 17 01:45:57.738617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.738578    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:45:57.738865 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.738837    2573 patch_prober.go:28] interesting pod/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 01:45:57.738951 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.738903    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 01:45:57.899623 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:57.899589    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:45:58.738871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:58.738817    2573 patch_prober.go:28] interesting pod/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 01:45:58.739275 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:58.738900    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 01:45:59.739102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:59.739063    2573 patch_prober.go:28] interesting pod/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 01:45:59.739507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:45:59.739121    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 01:46:00.739277 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:00.739240    2573 patch_prober.go:28] interesting pod/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 01:46:00.739688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:00.739305    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 01:46:01.738888 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:01.738849    2573 patch_prober.go:28] interesting pod/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 01:46:01.739089 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:01.738910    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 01:46:02.742813 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:02.742756    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:46:02.743267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:02.743250    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:46:02.743806 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:02.743786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:46:16.774200 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:16.774146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:46:25.479759 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:25.479723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:46:41.947931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:41.947904    2573 scope.go:117] "RemoveContainer" containerID="327b1e388841d19c5a07752b452c37ab49fd3aed30736170bc328c8ef2590467"
Sep 17 01:46:41.958483 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:41.958462    2573 scope.go:117] "RemoveContainer" containerID="55829f16b97b8d4fc3c6e311eaf8ed66566bbb0256aa0eb5956f9535f7606b4c"
Sep 17 01:46:43.494290 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:46:43.494241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:00.482731 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:00.482694    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:47:06.719108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.719013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:06.831363 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.831326    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"]
Sep 17 01:47:06.835202 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.835182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:06.837744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.837723    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:47:06.844282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.843989    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"]
Sep 17 01:47:06.949954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:06.949911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk\" (UID: \"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:07.050925 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:07.050835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk\" (UID: \"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:07.051501 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:07.051472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk\" (UID: \"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:07.147787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:07.147735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:07.419488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:07.419463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"]
Sep 17 01:47:07.421313 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:47:07.421282    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d538a4_d3e5_49ee_9b80_b7c7a8a2ca2e.slice/crio-bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0 WatchSource:0}: Error finding container bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0: Status 404 returned error can't find the container with id bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0
Sep 17 01:47:07.634517 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:07.634484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk" event={"ID":"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e","Type":"ContainerStarted","Data":"bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0"}
Sep 17 01:47:08.113708 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:08.113651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:08.485656 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:08.485567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:08.641241 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:08.641205    2573 generic.go:356] "Generic (PLEG): container finished" podID="c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" containerID="f0a8d87f9a45189a6bb4ab4f72c5ebea6edcaf24b1cbe9b496f0d60ff9df6293" exitCode=0
Sep 17 01:47:08.641503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:08.641289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk" event={"ID":"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e","Type":"ContainerDied","Data":"f0a8d87f9a45189a6bb4ab4f72c5ebea6edcaf24b1cbe9b496f0d60ff9df6293"}
Sep 17 01:47:09.221766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.221713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:09.787323 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.787298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:09.878523 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.878493    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca\") pod \"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e\" (UID: \"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e\") "
Sep 17 01:47:09.878890 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.878866    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" (UID: "c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:47:09.895701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.895677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:09.979527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:09.979445    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:47:10.609429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:10.609379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:10.654415 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:10.654379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk" event={"ID":"c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e","Type":"ContainerDied","Data":"bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0"}
Sep 17 01:47:10.654556 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:10.654434    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb092978469bf075f65aec42c5e68f88e2001e8a9b064c7fbacf5999fdef1da0"
Sep 17 01:47:10.654556 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:10.654394    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"
Sep 17 01:47:11.249663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:11.249631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:11.779896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:11.779869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:11.913522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:11.913490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:12.663155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:12.663121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:22.427721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.427680    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"]
Sep 17 01:47:22.428706 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.428682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:22.429972 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.429945    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-cc98e0-29826825-kwblx"]
Sep 17 01:47:22.459347 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.459315    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:47:22.459551 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.459523    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" podUID="3a003913-5644-4f65-b955-5e0cd72faddd" containerName="payload-pre-processing" containerID="cri-o://5b23559b33abe90468761fcac1ccfd11b3d1a458649acee7dde53c834f249154" gracePeriod=30
Sep 17 01:47:22.496073 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.496041    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:22.594315 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.594284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:22.619745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.619709    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"]
Sep 17 01:47:22.625105 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.625075    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-cc98e0-d65wk"]
Sep 17 01:47:22.700513 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.700239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:22.738360 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.737333    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a003913-5644-4f65-b955-5e0cd72faddd" containerID="5b23559b33abe90468761fcac1ccfd11b3d1a458649acee7dde53c834f249154" exitCode=0
Sep 17 01:47:22.738360 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.737535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" event={"ID":"3a003913-5644-4f65-b955-5e0cd72faddd","Type":"ContainerDied","Data":"5b23559b33abe90468761fcac1ccfd11b3d1a458649acee7dde53c834f249154"}
Sep 17 01:47:22.756840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.756807    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:47:22.901266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.901233    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt4fw\" (UniqueName: \"kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw\") pod \"3a003913-5644-4f65-b955-5e0cd72faddd\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") "
Sep 17 01:47:22.901454 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.901332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume\") pod \"3a003913-5644-4f65-b955-5e0cd72faddd\" (UID: \"3a003913-5644-4f65-b955-5e0cd72faddd\") "
Sep 17 01:47:22.901767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.901739    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a003913-5644-4f65-b955-5e0cd72faddd" (UID: "3a003913-5644-4f65-b955-5e0cd72faddd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:47:22.903415 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.903391    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw" (OuterVolumeSpecName: "kube-api-access-kt4fw") pod "3a003913-5644-4f65-b955-5e0cd72faddd" (UID: "3a003913-5644-4f65-b955-5e0cd72faddd"). InnerVolumeSpecName "kube-api-access-kt4fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:47:22.965399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:22.965271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:23.003092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.003058    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt4fw\" (UniqueName: \"kubernetes.io/projected/3a003913-5644-4f65-b955-5e0cd72faddd-kube-api-access-kt4fw\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:47:23.003092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.003087    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a003913-5644-4f65-b955-5e0cd72faddd-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:47:23.096206 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.096173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:23.744828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.744792    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"
Sep 17 01:47:23.744828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.744800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h" event={"ID":"3a003913-5644-4f65-b955-5e0cd72faddd","Type":"ContainerDied","Data":"873aabc0b7216b999827749f65cb2f073c3e7010e82a24f4e60211c0e18ed7a0"}
Sep 17 01:47:23.745302 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.744862    2573 scope.go:117] "RemoveContainer" containerID="5b23559b33abe90468761fcac1ccfd11b3d1a458649acee7dde53c834f249154"
Sep 17 01:47:23.766256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.766235    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:47:23.769581 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.769559    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h"]
Sep 17 01:47:23.799429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.799403    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a003913-5644-4f65-b955-5e0cd72faddd" path="/var/lib/kubelet/pods/3a003913-5644-4f65-b955-5e0cd72faddd/volumes"
Sep 17 01:47:23.799705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.799690    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844" path="/var/lib/kubelet/pods/3a3115ad-c38b-4c9a-8fcb-5c2c9ce53844/volumes"
Sep 17 01:47:23.799971 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.799958    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" path="/var/lib/kubelet/pods/c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e/volumes"
Sep 17 01:47:23.890441 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:23.890410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:24.578301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:24.578267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:25.204476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:25.204442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:25.728263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:25.728232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:26.460580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:26.460522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:27.101561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:27.101529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:28.650478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:28.650434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:28.707195 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:28.707174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:28.896098 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:28.896067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:36.685476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:36.685442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:41.982146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:41.982113    2573 scope.go:117] "RemoveContainer" containerID="fe0cafe27985cc6f9c19b07dd012181718f091b8935856b9de673bc611bef04b"
Sep 17 01:47:41.991065 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:41.991043    2573 scope.go:117] "RemoveContainer" containerID="53100fde534b9bc01e6846d1f5d985b1c56e538129dc47c47517905cbbbd8b65"
Sep 17 01:47:48.622515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:48.622483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:48.725665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:48.725628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:49.033366 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:49.033287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:51.064932 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:51.064880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:47:54.553472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:47:54.553433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:03.384909 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:03.384872    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:48:08.868406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:08.868377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:12.953125 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953088    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"]
Sep 17 01:48:12.953549 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953532    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a003913-5644-4f65-b955-5e0cd72faddd" containerName="payload-pre-processing"
Sep 17 01:48:12.953592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953552    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a003913-5644-4f65-b955-5e0cd72faddd" containerName="payload-pre-processing"
Sep 17 01:48:12.953592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953561    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" containerName="revoke-keys"
Sep 17 01:48:12.953592 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953567    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" containerName="revoke-keys"
Sep 17 01:48:12.953690 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953640    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d538a4-d3e5-49ee-9b80-b7c7a8a2ca2e" containerName="revoke-keys"
Sep 17 01:48:12.953690 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.953651    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a003913-5644-4f65-b955-5e0cd72faddd" containerName="payload-pre-processing"
Sep 17 01:48:12.956680 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.956662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:12.959046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.959019    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:48:12.963054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:12.963027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"]
Sep 17 01:48:13.063973 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.063940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc\" (UID: \"69f93ce5-d5ef-437e-9fe9-82532868aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:13.165410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.165373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc\" (UID: \"69f93ce5-d5ef-437e-9fe9-82532868aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:13.166037 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.166019    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc\" (UID: \"69f93ce5-d5ef-437e-9fe9-82532868aaa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:13.266062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.265942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:13.268895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.268869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:13.542983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.542948    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"]
Sep 17 01:48:13.545221 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:48:13.545188    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f93ce5_d5ef_437e_9fe9_82532868aaa0.slice/crio-3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d WatchSource:0}: Error finding container 3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d: Status 404 returned error can't find the container with id 3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d
Sep 17 01:48:13.940722 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:13.940693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:14.048123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:14.048073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc" event={"ID":"69f93ce5-d5ef-437e-9fe9-82532868aaa0","Type":"ContainerStarted","Data":"c4122ea056974eb61a819addb09f0ffbd76676fa8994a76a91e802b696234349"}
Sep 17 01:48:14.048557 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:14.048140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc" event={"ID":"69f93ce5-d5ef-437e-9fe9-82532868aaa0","Type":"ContainerStarted","Data":"3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d"}
Sep 17 01:48:14.063402 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:14.063355    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc" podStartSLOduration=2.063340749 podStartE2EDuration="2.063340749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:48:14.061613242 +0000 UTC m=+1592.705721318" watchObservedRunningTime="2026-09-17 01:48:14.063340749 +0000 UTC m=+1592.707448827"
Sep 17 01:48:14.640431 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:14.640395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:15.054385 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:15.054285    2573 generic.go:356] "Generic (PLEG): container finished" podID="69f93ce5-d5ef-437e-9fe9-82532868aaa0" containerID="c4122ea056974eb61a819addb09f0ffbd76676fa8994a76a91e802b696234349" exitCode=0
Sep 17 01:48:15.054808 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:15.054365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc" event={"ID":"69f93ce5-d5ef-437e-9fe9-82532868aaa0","Type":"ContainerDied","Data":"c4122ea056974eb61a819addb09f0ffbd76676fa8994a76a91e802b696234349"}
Sep 17 01:48:15.493449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:15.493416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:16.129744 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.129715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:16.219119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.219095    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:16.297248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.297214    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca\") pod \"69f93ce5-d5ef-437e-9fe9-82532868aaa0\" (UID: \"69f93ce5-d5ef-437e-9fe9-82532868aaa0\") "
Sep 17 01:48:16.297404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.297385    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69f93ce5-d5ef-437e-9fe9-82532868aaa0" (UID: "69f93ce5-d5ef-437e-9fe9-82532868aaa0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:16.297543 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.297530    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f93ce5-d5ef-437e-9fe9-82532868aaa0-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:48:16.660361 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:16.660331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:17.066603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:17.066509    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc" event={"ID":"69f93ce5-d5ef-437e-9fe9-82532868aaa0","Type":"ContainerDied","Data":"3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d"}
Sep 17 01:48:17.066603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:17.066532    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"
Sep 17 01:48:17.066603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:17.066571    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb8a681758063c71c385cc4771f760e573340e6181b95a34b682e6f40435d2d"
Sep 17 01:48:17.399530 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:17.399467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:18.120027 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:18.119999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:24.778511 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:24.778460    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:48:28.490362 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.490331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:28.518500 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.518468    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:48:28.518695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.518670    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" podUID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" containerName="payload-processing" containerID="cri-o://1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf" gracePeriod=30
Sep 17 01:48:28.590617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.590581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:28.686595 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.686558    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"]
Sep 17 01:48:28.689964 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.689729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:28.690793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.690751    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2a1db100-8pvpc"]
Sep 17 01:48:28.747878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.747757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:28.820203 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.820176    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:48:28.919758 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.919718    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsnnr\" (UniqueName: \"kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr\") pod \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") "
Sep 17 01:48:28.919758 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.919758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume\") pod \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\" (UID: \"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac\") "
Sep 17 01:48:28.920217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.920183    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" (UID: "f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:28.921820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:28.921786    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr" (OuterVolumeSpecName: "kube-api-access-zsnnr") pod "f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" (UID: "f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac"). InnerVolumeSpecName "kube-api-access-zsnnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:48:29.020892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.020814    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsnnr\" (UniqueName: \"kubernetes.io/projected/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-kube-api-access-zsnnr\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:48:29.020892 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.020843    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:48:29.096301 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.096266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:29.130400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.130359    2573 generic.go:356] "Generic (PLEG): container finished" podID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" containerID="1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf" exitCode=0
Sep 17 01:48:29.130538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.130413    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"
Sep 17 01:48:29.130538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.130431    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" event={"ID":"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac","Type":"ContainerDied","Data":"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"}
Sep 17 01:48:29.130538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.130479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf" event={"ID":"f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac","Type":"ContainerDied","Data":"835e82b1550700f109d13558bb60f65f4592763dc77bbdc452f0c86ab20bc23a"}
Sep 17 01:48:29.130538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.130501    2573 scope.go:117] "RemoveContainer" containerID="1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"
Sep 17 01:48:29.139587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.139571    2573 scope.go:117] "RemoveContainer" containerID="1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"
Sep 17 01:48:29.139885 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:48:29.139862    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf\": container with ID starting with 1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf not found: ID does not exist" containerID="1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"
Sep 17 01:48:29.139984 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.139890    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf"} err="failed to get container status \"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf\": rpc error: code = NotFound desc = could not find container \"1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf\": container with ID starting with 1845ce69a8ea6a278555c13d46eff36f2b13bdde7bb66833d8c92370f595fdbf not found: ID does not exist"
Sep 17 01:48:29.162970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.162718    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:48:29.167570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.167538    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf"]
Sep 17 01:48:29.668589 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.668552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:29.798884 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.798855    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f93ce5-d5ef-437e-9fe9-82532868aaa0" path="/var/lib/kubelet/pods/69f93ce5-d5ef-437e-9fe9-82532868aaa0/volumes"
Sep 17 01:48:29.799264 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:29.799251    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" path="/var/lib/kubelet/pods/f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac/volumes"
Sep 17 01:48:30.492153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:30.492120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:31.154572 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:31.154530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:31.810570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:31.810541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:31.911720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:31.911690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:32.494089 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:32.494054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:36.936679 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:36.936598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:42.111647 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:42.111604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:48:50.372567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:48:50.372534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:49:06.588035 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.588000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:06.691160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691130    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"]
Sep 17 01:49:06.691548 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691535    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" containerName="payload-processing"
Sep 17 01:49:06.691612 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691550    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" containerName="payload-processing"
Sep 17 01:49:06.691612 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f93ce5-d5ef-437e-9fe9-82532868aaa0" containerName="revoke-keys"
Sep 17 01:49:06.691612 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691570    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f93ce5-d5ef-437e-9fe9-82532868aaa0" containerName="revoke-keys"
Sep 17 01:49:06.691710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691635    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f93ce5-d5ef-437e-9fe9-82532868aaa0" containerName="revoke-keys"
Sep 17 01:49:06.691710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.691644    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e0dfd4-bd56-4f7c-86d8-c63f415d44ac" containerName="payload-processing"
Sep 17 01:49:06.694710 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.694694    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:06.697270 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.697249    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:49:06.701260 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.701235    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"]
Sep 17 01:49:06.774897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.774863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz\" (UID: \"d51489c5-8a55-416a-a87b-89a4fe369382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:06.875593 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.875553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz\" (UID: \"d51489c5-8a55-416a-a87b-89a4fe369382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:06.876190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:06.876171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz\" (UID: \"d51489c5-8a55-416a-a87b-89a4fe369382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:07.006167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:07.006136    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:07.075824 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:07.075797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:07.295471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:07.295445    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"]
Sep 17 01:49:07.296518 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:49:07.296489    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51489c5_8a55_416a_a87b_89a4fe369382.slice/crio-e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5 WatchSource:0}: Error finding container e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5: Status 404 returned error can't find the container with id e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5
Sep 17 01:49:07.348574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:07.348547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz" event={"ID":"d51489c5-8a55-416a-a87b-89a4fe369382","Type":"ContainerStarted","Data":"e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5"}
Sep 17 01:49:07.940618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:07.940531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:08.355830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:08.355795    2573 generic.go:356] "Generic (PLEG): container finished" podID="d51489c5-8a55-416a-a87b-89a4fe369382" containerID="51cad6e33678e7ed8b1b114416c9c12f9c0164a85f39d1d3d0d2a313fe6815ca" exitCode=0
Sep 17 01:49:08.356006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:08.355845    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz" event={"ID":"d51489c5-8a55-416a-a87b-89a4fe369382","Type":"ContainerDied","Data":"51cad6e33678e7ed8b1b114416c9c12f9c0164a85f39d1d3d0d2a313fe6815ca"}
Sep 17 01:49:08.723124 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:08.723026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:09.401845 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.401811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:09.506765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.506742    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:09.602420 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.602392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca\") pod \"d51489c5-8a55-416a-a87b-89a4fe369382\" (UID: \"d51489c5-8a55-416a-a87b-89a4fe369382\") "
Sep 17 01:49:09.602751 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.602728    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d51489c5-8a55-416a-a87b-89a4fe369382" (UID: "d51489c5-8a55-416a-a87b-89a4fe369382"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:49:09.704058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.703975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:49:09.704058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:09.704026    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51489c5-8a55-416a-a87b-89a4fe369382-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:10.081085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:10.081003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:10.368034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:10.368006    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"
Sep 17 01:49:10.368034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:10.368019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz" event={"ID":"d51489c5-8a55-416a-a87b-89a4fe369382","Type":"ContainerDied","Data":"e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5"}
Sep 17 01:49:10.368238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:10.368063    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a0addf58faacac55f7519bd42bbc5ce310e0416452b8722c7134c2fdd099a5"
Sep 17 01:49:11.041897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:11.041863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:11.583354 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:11.583320    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:49:11.623952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:11.623918    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:49:11.777097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:11.777060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:12.212372 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:12.212336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:13.375460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:13.375429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:14.575170 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:14.575136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:15.416506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:15.416473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:16.895943 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:16.895904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:17.982308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:17.982273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:18.037025 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:18.036993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:20.959384 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:20.959352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:21.032712 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:21.032677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:21.287766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:21.287673    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:49:21.287981 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:21.287952    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy" containerID="cri-o://be0456a2889a9806a98187176143e72deb7b9d1aa9a302641fe98809442dd6b2" gracePeriod=30
Sep 17 01:49:21.325388 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:21.325357    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:22.470289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.470259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:22.528948 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.528911    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"]
Sep 17 01:49:22.532858 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.532825    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-8be734-29826825-b7qrn"]
Sep 17 01:49:22.553665 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.553621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:22.619951 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.619918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:22.715166 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.715131    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"]
Sep 17 01:49:22.721644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.721564    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8be734-2wvnz"]
Sep 17 01:49:22.722204 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.722183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:22.803970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:22.803943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.080254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.080154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.181571 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.181541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.304235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.304208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.402048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.402017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.501709 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.501675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:23.800163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.800077    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dc7cfcc-8670-484d-a43f-79221bd8a33f" path="/var/lib/kubelet/pods/0dc7cfcc-8670-484d-a43f-79221bd8a33f/volumes"
Sep 17 01:49:23.800406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:23.800393    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51489c5-8a55-416a-a87b-89a4fe369382" path="/var/lib/kubelet/pods/d51489c5-8a55-416a-a87b-89a4fe369382/volumes"
Sep 17 01:49:24.041907 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:24.041874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:24.676316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:24.676282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:24.779123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:24.779091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:25.314680 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:25.314650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:26.240747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.240704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:26.469228 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.469194    2573 generic.go:356] "Generic (PLEG): container finished" podID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerID="be0456a2889a9806a98187176143e72deb7b9d1aa9a302641fe98809442dd6b2" exitCode=0
Sep 17 01:49:26.469384 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.469259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerDied","Data":"be0456a2889a9806a98187176143e72deb7b9d1aa9a302641fe98809442dd6b2"}
Sep 17 01:49:26.469384 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.469324    2573 scope.go:117] "RemoveContainer" containerID="1ad618a663790a9924aed59b8711a071ba04e06a1baa274fd3b1d3322b6bc863"
Sep 17 01:49:26.543087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.543062    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:49:26.602209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.602178    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" podUID="dac47f9e-50b8-4124-9f00-7bb57b42f044" containerName="main" containerID="cri-o://861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198" gracePeriod=45
Sep 17 01:49:26.642627 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.642596    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" podUID="f7cf864a-eab8-46a0-9283-4f53646beeac" containerName="main" containerID="cri-o://d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae" gracePeriod=45
Sep 17 01:49:26.659004 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.658980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659038    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659188 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659283    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659336    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659424 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659377    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7wp6\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659424 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659379    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:26.659532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659511    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs\") pod \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\" (UID: \"580cdc94-3199-4f7f-82ad-3cdabb8981bd\") "
Sep 17 01:49:26.659878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659484    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:49:26.659878 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659555    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:26.660007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659931    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.660007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659952    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.660007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659968    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.660007 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.659769    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:26.660192 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.660059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:26.661646 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.661614    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:26.661646 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.661631    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:49:26.661853 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.661792    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:26.661900 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.661871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6" (OuterVolumeSpecName: "kube-api-access-t7wp6") pod "580cdc94-3199-4f7f-82ad-3cdabb8981bd" (UID: "580cdc94-3199-4f7f-82ad-3cdabb8981bd"). InnerVolumeSpecName "kube-api-access-t7wp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:26.761254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761222    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.761254 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761251    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.761417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761264    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7wp6\" (UniqueName: \"kubernetes.io/projected/580cdc94-3199-4f7f-82ad-3cdabb8981bd-kube-api-access-t7wp6\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.761417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761278    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.761417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761288    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/580cdc94-3199-4f7f-82ad-3cdabb8981bd-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.761417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.761296    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/580cdc94-3199-4f7f-82ad-3cdabb8981bd-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:26.907684 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.907658    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:49:26.910880 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:26.910857    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:49:27.064503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064418    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.064503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064478    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064526    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064557    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064591    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p64g\" (UniqueName: \"kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064648    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.064737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064720    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home" (OuterVolumeSpecName: "home") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064869    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache" (OuterVolumeSpecName: "model-cache") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064890    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home" (OuterVolumeSpecName: "home") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache" (OuterVolumeSpecName: "model-cache") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.064944    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs\") pod \"f7cf864a-eab8-46a0-9283-4f53646beeac\" (UID: \"f7cf864a-eab8-46a0-9283-4f53646beeac\") "
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065033    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht7m9\" (UniqueName: \"kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.065079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.065455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.065455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065128    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir\") pod \"dac47f9e-50b8-4124-9f00-7bb57b42f044\" (UID: \"dac47f9e-50b8-4124-9f00-7bb57b42f044\") "
Sep 17 01:49:27.065563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065479    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-tmp-dir\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.065563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065500    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-home\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.065563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065513    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-model-cache\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.065563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065528    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-home\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.065563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065540    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-model-cache\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.065849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.065650    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.067423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:49:27.067423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067416    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm" (OuterVolumeSpecName: "dshm") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.067573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067449    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g" (OuterVolumeSpecName: "kube-api-access-6p64g") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "kube-api-access-6p64g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:27.067573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067461    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm" (OuterVolumeSpecName: "dshm") pod "f7cf864a-eab8-46a0-9283-4f53646beeac" (UID: "f7cf864a-eab8-46a0-9283-4f53646beeac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:27.067573 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067526    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9" (OuterVolumeSpecName: "kube-api-access-ht7m9") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "kube-api-access-ht7m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:27.067704 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.067684    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dac47f9e-50b8-4124-9f00-7bb57b42f044" (UID: "dac47f9e-50b8-4124-9f00-7bb57b42f044"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:49:27.167020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.166984    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac47f9e-50b8-4124-9f00-7bb57b42f044-tls-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167017    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-tmp-dir\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167025    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cf864a-eab8-46a0-9283-4f53646beeac-dshm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167034    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p64g\" (UniqueName: \"kubernetes.io/projected/f7cf864a-eab8-46a0-9283-4f53646beeac-kube-api-access-6p64g\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167043    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac47f9e-50b8-4124-9f00-7bb57b42f044-dshm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167051    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cf864a-eab8-46a0-9283-4f53646beeac-tls-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.167263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.167059    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht7m9\" (UniqueName: \"kubernetes.io/projected/dac47f9e-50b8-4124-9f00-7bb57b42f044-kube-api-access-ht7m9\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:27.476326 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.476292    2573 generic.go:356] "Generic (PLEG): container finished" podID="f7cf864a-eab8-46a0-9283-4f53646beeac" containerID="d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae" exitCode=0
Sep 17 01:49:27.476826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.476345    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"
Sep 17 01:49:27.476826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.476375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" event={"ID":"f7cf864a-eab8-46a0-9283-4f53646beeac","Type":"ContainerDied","Data":"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"}
Sep 17 01:49:27.476826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.476412    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n" event={"ID":"f7cf864a-eab8-46a0-9283-4f53646beeac","Type":"ContainerDied","Data":"607f3a289083007d431037c915bfd9ad9f14cf1ab5772eea7def51777f36888a"}
Sep 17 01:49:27.476826 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.476434    2573 scope.go:117] "RemoveContainer" containerID="d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"
Sep 17 01:49:27.477961 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.477943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"
Sep 17 01:49:27.478068 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.477985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz" event={"ID":"580cdc94-3199-4f7f-82ad-3cdabb8981bd","Type":"ContainerDied","Data":"b7d786baba6746e4c72dcc21b83e4c06514e17a011cc0542fa802e23c0e4e3d4"}
Sep 17 01:49:27.479534 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.479506    2573 generic.go:356] "Generic (PLEG): container finished" podID="dac47f9e-50b8-4124-9f00-7bb57b42f044" containerID="861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198" exitCode=0
Sep 17 01:49:27.479643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.479550    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"
Sep 17 01:49:27.479643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.479563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" event={"ID":"dac47f9e-50b8-4124-9f00-7bb57b42f044","Type":"ContainerDied","Data":"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"}
Sep 17 01:49:27.479643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.479594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb" event={"ID":"dac47f9e-50b8-4124-9f00-7bb57b42f044","Type":"ContainerDied","Data":"d765a85da3410faec8667668a14f1c527f6982b95d4fc545de4df15183706247"}
Sep 17 01:49:27.487464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.487448    2573 scope.go:117] "RemoveContainer" containerID="d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"
Sep 17 01:49:27.488032 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:49:27.487738    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae\": container with ID starting with d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae not found: ID does not exist" containerID="d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"
Sep 17 01:49:27.488032 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.487787    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae"} err="failed to get container status \"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae\": rpc error: code = NotFound desc = could not find container \"d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae\": container with ID starting with d2d746fc571b5168e7df03bb1efba816d1243e1ea017340188a88561fcc848ae not found: ID does not exist"
Sep 17 01:49:27.488032 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.487822    2573 scope.go:117] "RemoveContainer" containerID="be0456a2889a9806a98187176143e72deb7b9d1aa9a302641fe98809442dd6b2"
Sep 17 01:49:27.496375 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.496356    2573 scope.go:117] "RemoveContainer" containerID="861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"
Sep 17 01:49:27.505032 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.505008    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:49:27.509211 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.509189    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/premium-w0-8be734-kserve-d577fb5ff-ht98n"]
Sep 17 01:49:27.513123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.513102    2573 scope.go:117] "RemoveContainer" containerID="861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"
Sep 17 01:49:27.513567 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:49:27.513545    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198\": container with ID starting with 861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198 not found: ID does not exist" containerID="861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"
Sep 17 01:49:27.513653 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.513572    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198"} err="failed to get container status \"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198\": rpc error: code = NotFound desc = could not find container \"861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198\": container with ID starting with 861bfcc7086f5a7414010d488e7ddf0ab7299f21f79a4d876aa5d55b8eeb6198 not found: ID does not exist"
Sep 17 01:49:27.515004 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.514986    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:49:27.519012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.518980    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz"]
Sep 17 01:49:27.534170 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.534146    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:49:27.535721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.535703    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-8be734/distinct-w0-8be734-kserve-7987b4cb54-hj6bb"]
Sep 17 01:49:27.799726 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.799639    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" path="/var/lib/kubelet/pods/580cdc94-3199-4f7f-82ad-3cdabb8981bd/volumes"
Sep 17 01:49:27.800148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.800128    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac47f9e-50b8-4124-9f00-7bb57b42f044" path="/var/lib/kubelet/pods/dac47f9e-50b8-4124-9f00-7bb57b42f044/volumes"
Sep 17 01:49:27.800538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:27.800518    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cf864a-eab8-46a0-9283-4f53646beeac" path="/var/lib/kubelet/pods/f7cf864a-eab8-46a0-9283-4f53646beeac/volumes"
Sep 17 01:49:28.827148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:28.827113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:28.927984 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:28.927947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:29.066104 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:29.066068    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:49:29.066393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:29.066359    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" containerID="cri-o://47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a" gracePeriod=30
Sep 17 01:49:29.082432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:29.082340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:30.616199 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:30.616151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:30.677023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:30.676996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:31.285304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:31.285272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:32.984289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:32.984252    2573 patch_prober.go:28] interesting pod/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:49:32.984658 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:32.984314    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:49:34.324119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.324095    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:49:34.429011 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.428981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429043    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2zvs\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429112    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429134    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429173 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429201    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token\") pod \"78b3758c-5438-4860-bbb9-36584dab3207\" (UID: \"78b3758c-5438-4860-bbb9-36584dab3207\") "
Sep 17 01:49:34.429474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429308    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:34.429474 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429481    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429462    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data" (OuterVolumeSpecName: "istio-data") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429600    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429635    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429656    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.429677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.429670    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.431488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.431456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token" (OuterVolumeSpecName: "istio-token") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:34.431488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.431477    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:49:34.431669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.431601    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs" (OuterVolumeSpecName: "kube-api-access-m2zvs") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "kube-api-access-m2zvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:34.431669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.431614    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78b3758c-5438-4860-bbb9-36584dab3207" (UID: "78b3758c-5438-4860-bbb9-36584dab3207"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:49:34.522411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.522367    2573 generic.go:356] "Generic (PLEG): container finished" podID="78b3758c-5438-4860-bbb9-36584dab3207" containerID="47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a" exitCode=0
Sep 17 01:49:34.522591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.522418    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"
Sep 17 01:49:34.522591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.522447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerDied","Data":"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"}
Sep 17 01:49:34.522591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.522507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx" event={"ID":"78b3758c-5438-4860-bbb9-36584dab3207","Type":"ContainerDied","Data":"0aec528d39fa26f83db3633b7167bd86cef4e5af60f8d2c24afdb56a6c02d9b3"}
Sep 17 01:49:34.522591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.522540    2573 scope.go:117] "RemoveContainer" containerID="47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530288    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b3758c-5438-4860-bbb9-36584dab3207-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530314    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530328    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b3758c-5438-4860-bbb9-36584dab3207-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530337    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2zvs\" (UniqueName: \"kubernetes.io/projected/78b3758c-5438-4860-bbb9-36584dab3207-kube-api-access-m2zvs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530346    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.530392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.530355    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b3758c-5438-4860-bbb9-36584dab3207-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:49:34.532023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.532002    2573 scope.go:117] "RemoveContainer" containerID="55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"
Sep 17 01:49:34.541845 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.541761    2573 scope.go:117] "RemoveContainer" containerID="47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"
Sep 17 01:49:34.542293 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:49:34.542273    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a\": container with ID starting with 47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a not found: ID does not exist" containerID="47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"
Sep 17 01:49:34.542363 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.542299    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a"} err="failed to get container status \"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a\": rpc error: code = NotFound desc = could not find container \"47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a\": container with ID starting with 47f86825ebb662dcc88091b35efbf11ce3045179c3f34f253004d9c106a68e9a not found: ID does not exist"
Sep 17 01:49:34.542363 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.542316    2573 scope.go:117] "RemoveContainer" containerID="55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"
Sep 17 01:49:34.542597 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:49:34.542582    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35\": container with ID starting with 55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35 not found: ID does not exist" containerID="55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"
Sep 17 01:49:34.542645 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.542601    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35"} err="failed to get container status \"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35\": rpc error: code = NotFound desc = could not find container \"55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35\": container with ID starting with 55f78760803dc5824d09f76408c622434c23e64d38f554befa969c36b5b6ed35 not found: ID does not exist"
Sep 17 01:49:34.546527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.546504    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:49:34.549095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:34.549072    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx"]
Sep 17 01:49:35.799604 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:35.799569    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78b3758c-5438-4860-bbb9-36584dab3207" path="/var/lib/kubelet/pods/78b3758c-5438-4860-bbb9-36584dab3207/volumes"
Sep 17 01:49:36.171104 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:36.171070    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:49:37.683399 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:37.683365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:37.750522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:37.750486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:37.833867 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:37.833837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:48.348329 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:48.348290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:48.556786 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:48.556752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:48.849287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:48.849245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:48.948696 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:48.948661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:49.211564 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:49.211526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:54.073992 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:54.073960    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:49:54.858599 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:54.858559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:49:55.803976 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:49:55.803949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:09.075356 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:09.075254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:50:09.427673 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:09.427641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:15.250910 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:15.250875    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:15.348580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:15.348551    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:15.568899 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:15.568818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:15.857998 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:15.857968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:15.992412 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:15.992378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:17.884845 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:17.884812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:21.598485 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:21.598451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:22.261298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:22.261257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:22.368477 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:22.368438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:22.478663 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:22.478628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:23.052179 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:23.052133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:23.696804 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:23.696741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:24.355864 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:24.355830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:25.099674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:25.099635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:25.199030 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:25.198999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:25.432587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:25.432556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:25.569409 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:25.569378    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:25.662169 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:25.662133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:27.669367 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:27.669339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:29.976189 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:29.976162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:50:31.223422 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:31.223385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:36.199844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:36.199768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:42.055924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:42.055891    2573 scope.go:117] "RemoveContainer" containerID="6d7eebb778f5db93cfb14a9a25571572bb8bf2523feb1c3dcdbc46eebc060f65"
Sep 17 01:50:46.010429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:46.010396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:47.298008 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:47.297974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:47.398669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:47.398623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:47.731574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:47.731539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:47.922893 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:47.922865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:48.042194 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:48.042119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:48.179450 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:48.179415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:48.278283 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:48.278251    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:50:48.588004 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:48.587963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:49.397505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:49.397471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:50.055783 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:50.055739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:50.583859 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:50.583826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:50.678223 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:50.678193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:50.890392 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:50.890356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:51.615844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:51.615811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:52.367189 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:52.367157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:53.062553 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:53.062519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:53.692497 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:53.692457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:54.397459 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:54.397432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:54.459721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:54.459688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:54.605780 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:54.605751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:54.849388 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:54.849308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:54.933790 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:54.933753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:50:55.705698 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:50:55.705654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:00.083150 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:00.083114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:51:13.863076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863046    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:51:13.863449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863421    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cf864a-eab8-46a0-9283-4f53646beeac" containerName="main"
Sep 17 01:51:13.863449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863437    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cf864a-eab8-46a0-9283-4f53646beeac" containerName="main"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863458    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863467    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863484    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac47f9e-50b8-4124-9f00-7bb57b42f044" containerName="main"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863493    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac47f9e-50b8-4124-9f00-7bb57b42f044" containerName="main"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863501    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863506    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863513    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863518    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863533    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51489c5-8a55-416a-a87b-89a4fe369382" containerName="revoke-keys"
Sep 17 01:51:13.863538 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863538    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51489c5-8a55-416a-a87b-89a4fe369382" containerName="revoke-keys"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863600    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cf864a-eab8-46a0-9283-4f53646beeac" containerName="main"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863608    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dac47f9e-50b8-4124-9f00-7bb57b42f044" containerName="main"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863614    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51489c5-8a55-416a-a87b-89a4fe369382" containerName="revoke-keys"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863619    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863626    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b3758c-5438-4860-bbb9-36584dab3207" containerName="istio-proxy"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863633    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:13.863906 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.863639    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:13.866672 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.866646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.870233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.870210    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-361849\"/\"openshift-service-ca.crt\""
Sep 17 01:51:13.870233 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.870223    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-361849\"/\"default-dockercfg-vqzvr\""
Sep 17 01:51:13.870436 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.870255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-361849\"/\"sub-test-model-361849-kserve-self-signed-certs\""
Sep 17 01:51:13.870436 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.870263    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-361849\"/\"kube-root-ca.crt\""
Sep 17 01:51:13.876134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.876109    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:51:13.890814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.890792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:13.917167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-765kl\" (UniqueName: \"kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.917263 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.917313 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.917357 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.917407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:13.917407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:13.917391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018643 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-765kl\" (UniqueName: \"kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.018847 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.018706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.019055 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.019030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.019125 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.019071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.019183 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.019150    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.022576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.022549    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.024693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.024671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.030664 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.030638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-765kl\" (UniqueName: \"kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl\") pod \"sub-test-model-361849-kserve-f5ff6dcc-nb4nb\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") " pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.177053 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.176965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:14.454029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:14.453997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:51:14.456742 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:51:14.456714    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dfdcf1e_508f_4d6d_94e6_f5f1fba89237.slice/crio-e0c8cfd262934eb24ef2e743984807c862c4d7e66e8c6db387d4ff7b90522973 WatchSource:0}: Error finding container e0c8cfd262934eb24ef2e743984807c862c4d7e66e8c6db387d4ff7b90522973: Status 404 returned error can't find the container with id e0c8cfd262934eb24ef2e743984807c862c4d7e66e8c6db387d4ff7b90522973
Sep 17 01:51:15.043047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:15.043007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" event={"ID":"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237","Type":"ContainerStarted","Data":"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"}
Sep 17 01:51:15.043047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:15.043053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" event={"ID":"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237","Type":"ContainerStarted","Data":"e0c8cfd262934eb24ef2e743984807c862c4d7e66e8c6db387d4ff7b90522973"}
Sep 17 01:51:15.063319 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:15.063273    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" podStartSLOduration=2.063257928 podStartE2EDuration="2.063257928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:51:15.060790011 +0000 UTC m=+1773.704898101" watchObservedRunningTime="2026-09-17 01:51:15.063257928 +0000 UTC m=+1773.707366015"
Sep 17 01:51:15.211730 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:15.211702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:16.456841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:16.456806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:17.208251 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:17.208218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:17.845927 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:17.845880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:18.375991 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:18.375954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:18.776101 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:18.776023    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:51:19.128475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:19.128437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:19.829856 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:19.829808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:20.493718 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:20.493677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:20.653926 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:20.653896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:23.496343 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.496308    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"]
Sep 17 01:51:23.496719 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.496705    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:23.496766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.496721    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="580cdc94-3199-4f7f-82ad-3cdabb8981bd" containerName="istio-proxy"
Sep 17 01:51:23.500015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.499993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:23.502506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.502481    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:51:23.507423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.507298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"]
Sep 17 01:51:23.602835 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.602799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw\" (UID: \"7bdfb69e-03b8-4fcd-a926-c1055e67caa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:23.704378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.704346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw\" (UID: \"7bdfb69e-03b8-4fcd-a926-c1055e67caa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:23.705003 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.704982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw\" (UID: \"7bdfb69e-03b8-4fcd-a926-c1055e67caa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:23.813294 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.813214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:23.900117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:23.900086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:24.085308 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:24.085278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"]
Sep 17 01:51:24.086324 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:51:24.086294    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdfb69e_03b8_4fcd_a926_c1055e67caa7.slice/crio-4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8 WatchSource:0}: Error finding container 4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8: Status 404 returned error can't find the container with id 4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8
Sep 17 01:51:24.177714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:24.177693    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:24.177863 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:24.177788    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:24.190406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:24.190385    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:24.623905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:24.623869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:25.097404 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:25.097320    2573 generic.go:356] "Generic (PLEG): container finished" podID="7bdfb69e-03b8-4fcd-a926-c1055e67caa7" containerID="6fe2886ff28df72bd57f867edb7364671f398894478968d5b52961c56315f18b" exitCode=0
Sep 17 01:51:25.097545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:25.097410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw" event={"ID":"7bdfb69e-03b8-4fcd-a926-c1055e67caa7","Type":"ContainerDied","Data":"6fe2886ff28df72bd57f867edb7364671f398894478968d5b52961c56315f18b"}
Sep 17 01:51:25.097545 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:25.097506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw" event={"ID":"7bdfb69e-03b8-4fcd-a926-c1055e67caa7","Type":"ContainerStarted","Data":"4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8"}
Sep 17 01:51:25.109056 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:25.109023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:51:25.389695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:25.389664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:26.000870 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.000821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:26.234150 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.234125    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:26.337131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.337056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca\") pod \"7bdfb69e-03b8-4fcd-a926-c1055e67caa7\" (UID: \"7bdfb69e-03b8-4fcd-a926-c1055e67caa7\") "
Sep 17 01:51:26.337461 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.337441    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7bdfb69e-03b8-4fcd-a926-c1055e67caa7" (UID: "7bdfb69e-03b8-4fcd-a926-c1055e67caa7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:51:26.437733 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.437702    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdfb69e-03b8-4fcd-a926-c1055e67caa7-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:51:26.662887 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:26.662854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:27.109025 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:27.108994    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"
Sep 17 01:51:27.109396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:27.109029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw" event={"ID":"7bdfb69e-03b8-4fcd-a926-c1055e67caa7","Type":"ContainerDied","Data":"4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8"}
Sep 17 01:51:27.109396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:27.109075    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c311fc749b2ba484a08c54e02bc0a823a1f357f68c3a4ff579b968ff62e21b8"
Sep 17 01:51:27.394020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:27.393939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:28.001895 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:28.001858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:28.659999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:28.659958    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:29.979284 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:29.979256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:37.675700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:37.675606    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:51:39.028048 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.028018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.090481 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.090435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.154102 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.154058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.198373 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.198343    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"]
Sep 17 01:51:39.201945 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.201921    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1cf28c-mb9tw"]
Sep 17 01:51:39.210677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.210647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.556139 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.556103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.688801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.688755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:39.799498 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:39.799469    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bdfb69e-03b8-4fcd-a926-c1055e67caa7" path="/var/lib/kubelet/pods/7bdfb69e-03b8-4fcd-a926-c1055e67caa7/volumes"
Sep 17 01:51:40.490695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:40.490615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:41.309449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:41.309400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:41.825563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:41.825481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:42.076167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:42.076077    2573 scope.go:117] "RemoveContainer" containerID="456e88078fdcbe417b6a6e2e3558281c587d66f66afa22c9194e0fe5229e35a1"
Sep 17 01:51:42.085114 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:42.085096    2573 scope.go:117] "RemoveContainer" containerID="bfd365f68ae350563f6341779b0ade46d3f33a54df020168fab594986ac7e9b0"
Sep 17 01:51:42.093085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:42.093050    2573 scope.go:117] "RemoveContainer" containerID="984a6b24e0257fc9b6c9e415d0e4a9f42507bca168b483152e7c249ee2310eee"
Sep 17 01:51:42.100827 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:42.100805    2573 scope.go:117] "RemoveContainer" containerID="0a882b4c2dc7930efcf0d914c84ec312feb5c7b33095fd183bb37c49053f3c79"
Sep 17 01:51:42.575446 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:42.575413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:43.197183 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:43.197153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:45.527734 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:45.527702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:45.594825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:45.594767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:45.781730 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:45.781651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:46.089129 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.089041    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"]
Sep 17 01:51:46.089535 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.089516    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdfb69e-03b8-4fcd-a926-c1055e67caa7" containerName="revoke-keys"
Sep 17 01:51:46.089651 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.089538    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdfb69e-03b8-4fcd-a926-c1055e67caa7" containerName="revoke-keys"
Sep 17 01:51:46.089705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.089652    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bdfb69e-03b8-4fcd-a926-c1055e67caa7" containerName="revoke-keys"
Sep 17 01:51:46.093034 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.093008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:46.095292 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.095257    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:51:46.099160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.099131    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"]
Sep 17 01:51:46.213234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.213196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv\" (UID: \"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:46.314515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.314482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv\" (UID: \"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:46.315110 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.315089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv\" (UID: \"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:46.406445 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.406413    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:46.683544 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.683512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"]
Sep 17 01:51:46.684203 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:51:46.684171    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1474b3_0ee0_43dc_8a3c_a5026c37cf04.slice/crio-617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003 WatchSource:0}: Error finding container 617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003: Status 404 returned error can't find the container with id 617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003
Sep 17 01:51:46.891495 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:46.891461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:47.224289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:47.224252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv" event={"ID":"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04","Type":"ContainerStarted","Data":"7b5ba32218a5da8acdc24a22d284d5acd08fdba2da38ba0528e594d4164b76eb"}
Sep 17 01:51:47.224478 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:47.224309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv" event={"ID":"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04","Type":"ContainerStarted","Data":"617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003"}
Sep 17 01:51:47.241096 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:47.241051    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv" podStartSLOduration=1.241036481 podStartE2EDuration="1.241036481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:51:47.239265829 +0000 UTC m=+1805.883373950" watchObservedRunningTime="2026-09-17 01:51:47.241036481 +0000 UTC m=+1805.885144560"
Sep 17 01:51:47.496939 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:47.496908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:48.230859 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:48.230820    2573 generic.go:356] "Generic (PLEG): container finished" podID="0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" containerID="7b5ba32218a5da8acdc24a22d284d5acd08fdba2da38ba0528e594d4164b76eb" exitCode=0
Sep 17 01:51:48.231334 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:48.230909    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv" event={"ID":"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04","Type":"ContainerDied","Data":"7b5ba32218a5da8acdc24a22d284d5acd08fdba2da38ba0528e594d4164b76eb"}
Sep 17 01:51:48.407134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:48.407102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:49.011963 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.011935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:49.371904 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.371876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:49.543515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.543433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca\") pod \"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04\" (UID: \"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04\") "
Sep 17 01:51:49.543787 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.543753    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" (UID: "0b1474b3-0ee0-43dc-8a3c-a5026c37cf04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:51:49.645111 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.645082    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:51:49.664143 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:49.664103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:50.242692 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:50.242664    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"
Sep 17 01:51:50.242692 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:50.242670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv" event={"ID":"0b1474b3-0ee0-43dc-8a3c-a5026c37cf04","Type":"ContainerDied","Data":"617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003"}
Sep 17 01:51:50.242971 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:50.242725    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="617707faefdd6063f2afa9383501d9839739b1962f09c8f8f37ba61c9969f003"
Sep 17 01:51:50.494831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:50.494723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:51:55.480208 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:51:55.480170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:52:01.556959 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.556926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:01.658875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.658841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:01.731759 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.731715    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"]
Sep 17 01:52:01.733047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.733022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:01.733476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.733453    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6f3c6f-xrmsv"]
Sep 17 01:52:01.786615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.786587    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:01.798877 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:01.798835    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" path="/var/lib/kubelet/pods/0b1474b3-0ee0-43dc-8a3c-a5026c37cf04/volumes"
Sep 17 01:52:02.068954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:02.068914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:02.130792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:02.130737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:02.894752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:02.894712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:03.430720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:03.430688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:04.072019 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:04.071980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:04.895408 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:04.895372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:05.676153 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:05.676116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:06.468476 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:06.468443    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:52:06.497767 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:06.497740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:07.876913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:07.876879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:07.936142 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:07.936114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:08.119077 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.119046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:08.419654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.419621    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"]
Sep 17 01:52:08.420043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.420029    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" containerName="revoke-keys"
Sep 17 01:52:08.420097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.420045    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" containerName="revoke-keys"
Sep 17 01:52:08.420134 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.420111    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b1474b3-0ee0-43dc-8a3c-a5026c37cf04" containerName="revoke-keys"
Sep 17 01:52:08.422979 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.422963    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:08.425213 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.425192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:52:08.430342 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.430313    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"]
Sep 17 01:52:08.519596 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.519553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv\" (UID: \"0fac06a0-206b-439a-ab41-32b022d66cb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:08.626797 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.621272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv\" (UID: \"0fac06a0-206b-439a-ab41-32b022d66cb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:08.626797 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.622195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv\" (UID: \"0fac06a0-206b-439a-ab41-32b022d66cb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:08.736192 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:08.736108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:09.008248 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.008224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"]
Sep 17 01:52:09.010453 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:52:09.010417    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fac06a0_206b_439a_ab41_32b022d66cb9.slice/crio-7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4 WatchSource:0}: Error finding container 7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4: Status 404 returned error can't find the container with id 7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4
Sep 17 01:52:09.070157 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.070123    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:52:09.336062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.335984    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv" event={"ID":"0fac06a0-206b-439a-ab41-32b022d66cb9","Type":"ContainerStarted","Data":"f607defbd89bf36019d35a9df0cee4371257adb6fb2be5beae8f11e7d4b6d2bf"}
Sep 17 01:52:09.336062 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.336038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv" event={"ID":"0fac06a0-206b-439a-ab41-32b022d66cb9","Type":"ContainerStarted","Data":"7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4"}
Sep 17 01:52:09.352872 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.352826    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv" podStartSLOduration=1.352810561 podStartE2EDuration="1.352810561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:52:09.351019089 +0000 UTC m=+1827.995127187" watchObservedRunningTime="2026-09-17 01:52:09.352810561 +0000 UTC m=+1827.996918641"
Sep 17 01:52:09.481718 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.481683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:09.937539 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:09.937509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:10.342317 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:10.342278    2573 generic.go:356] "Generic (PLEG): container finished" podID="0fac06a0-206b-439a-ab41-32b022d66cb9" containerID="f607defbd89bf36019d35a9df0cee4371257adb6fb2be5beae8f11e7d4b6d2bf" exitCode=0
Sep 17 01:52:10.342736 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:10.342344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv" event={"ID":"0fac06a0-206b-439a-ab41-32b022d66cb9","Type":"ContainerDied","Data":"f607defbd89bf36019d35a9df0cee4371257adb6fb2be5beae8f11e7d4b6d2bf"}
Sep 17 01:52:10.561699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:10.561666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:11.241953 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.241917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:11.482344 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.482315    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:11.546830 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.546729    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca\") pod \"0fac06a0-206b-439a-ab41-32b022d66cb9\" (UID: \"0fac06a0-206b-439a-ab41-32b022d66cb9\") "
Sep 17 01:52:11.547128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.547105    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fac06a0-206b-439a-ab41-32b022d66cb9" (UID: "0fac06a0-206b-439a-ab41-32b022d66cb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:11.648117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.648091    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac06a0-206b-439a-ab41-32b022d66cb9-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:11.907533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:11.907489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:12.354329 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:12.354297    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"
Sep 17 01:52:12.354532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:12.354333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv" event={"ID":"0fac06a0-206b-439a-ab41-32b022d66cb9","Type":"ContainerDied","Data":"7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4"}
Sep 17 01:52:12.354532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:12.354379    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b7a260c7f298764ee0b77b743f6094bf5d5fe372185ec86a906cd500816ebf4"
Sep 17 01:52:18.880670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.880624    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"]
Sep 17 01:52:18.882675 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.882645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:18.884801 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.884765    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-474b22-29826825-548rz"]
Sep 17 01:52:18.919373 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.919339    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:52:18.919626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.919571    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" podUID="7c70820f-0397-412f-89c9-23d0f66ce3c6" containerName="payload-pre-processing" containerID="cri-o://070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3" gracePeriod=30
Sep 17 01:52:18.960003 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:18.959974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:19.058547 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.057812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:19.076138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.076108    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"]
Sep 17 01:52:19.077812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.077785    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-474b22-95bjv"]
Sep 17 01:52:19.159460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.159432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:19.177309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.174322    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:52:19.317704 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.317667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume\") pod \"7c70820f-0397-412f-89c9-23d0f66ce3c6\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") "
Sep 17 01:52:19.317897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.317806    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn6cm\" (UniqueName: \"kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm\") pod \"7c70820f-0397-412f-89c9-23d0f66ce3c6\" (UID: \"7c70820f-0397-412f-89c9-23d0f66ce3c6\") "
Sep 17 01:52:19.318150 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.318111    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c70820f-0397-412f-89c9-23d0f66ce3c6" (UID: "7c70820f-0397-412f-89c9-23d0f66ce3c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:19.319879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.319853    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm" (OuterVolumeSpecName: "kube-api-access-hn6cm") pod "7c70820f-0397-412f-89c9-23d0f66ce3c6" (UID: "7c70820f-0397-412f-89c9-23d0f66ce3c6"). InnerVolumeSpecName "kube-api-access-hn6cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:19.395964 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.395926    2573 generic.go:356] "Generic (PLEG): container finished" podID="7c70820f-0397-412f-89c9-23d0f66ce3c6" containerID="070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3" exitCode=0
Sep 17 01:52:19.396131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.395972    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"
Sep 17 01:52:19.396131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.395990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" event={"ID":"7c70820f-0397-412f-89c9-23d0f66ce3c6","Type":"ContainerDied","Data":"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"}
Sep 17 01:52:19.396131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.396033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9" event={"ID":"7c70820f-0397-412f-89c9-23d0f66ce3c6","Type":"ContainerDied","Data":"2c3c31469cfcd007fb5cf831351d6babaf7a512b813e811d6a7e0676daabbb79"}
Sep 17 01:52:19.396131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.396054    2573 scope.go:117] "RemoveContainer" containerID="070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"
Sep 17 01:52:19.405586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.405567    2573 scope.go:117] "RemoveContainer" containerID="070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"
Sep 17 01:52:19.405856 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:19.405836    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3\": container with ID starting with 070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3 not found: ID does not exist" containerID="070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"
Sep 17 01:52:19.405911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.405863    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3"} err="failed to get container status \"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3\": rpc error: code = NotFound desc = could not find container \"070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3\": container with ID starting with 070e0ae35c74853a7ca064943a3cf074ac78b34b77716e6d295cfd68912f7be3 not found: ID does not exist"
Sep 17 01:52:19.419640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.419613    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c70820f-0397-412f-89c9-23d0f66ce3c6-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:19.419742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.419644    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn6cm\" (UniqueName: \"kubernetes.io/projected/7c70820f-0397-412f-89c9-23d0f66ce3c6-kube-api-access-hn6cm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:19.432945 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.432917    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:52:19.434655 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.434636    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9"]
Sep 17 01:52:19.497695 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.497666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:19.590340 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.590312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:19.800821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.800710    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fac06a0-206b-439a-ab41-32b022d66cb9" path="/var/lib/kubelet/pods/0fac06a0-206b-439a-ab41-32b022d66cb9/volumes"
Sep 17 01:52:19.801237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.801212    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd41c35-46f0-4ccc-89c0-d1a27a5de639" path="/var/lib/kubelet/pods/7bd41c35-46f0-4ccc-89c0-d1a27a5de639/volumes"
Sep 17 01:52:19.801721 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:19.801700    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c70820f-0397-412f-89c9-23d0f66ce3c6" path="/var/lib/kubelet/pods/7c70820f-0397-412f-89c9-23d0f66ce3c6/volumes"
Sep 17 01:52:20.209868 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:20.209836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:20.901572 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:20.901535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:21.488520 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.488465    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" podUID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" containerName="main" containerID="cri-o://7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c" gracePeriod=45
Sep 17 01:52:21.698752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.698718    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:21.738217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.738194    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:52:21.844669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-765kl\" (UniqueName: \"kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.844669 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844656    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.844897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844677    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.844897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.844897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844755    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.844897 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.844813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs\") pod \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\" (UID: \"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237\") "
Sep 17 01:52:21.845088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.845022    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:21.845088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.845030    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache" (OuterVolumeSpecName: "model-cache") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:21.845212 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.845098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home" (OuterVolumeSpecName: "home") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:21.847031 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.846995    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:52:21.847158 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.847039    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl" (OuterVolumeSpecName: "kube-api-access-765kl") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "kube-api-access-765kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:21.847158 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.847057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm" (OuterVolumeSpecName: "dshm") pod "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" (UID: "7dfdcf1e-508f-4d6d-94e6-f5f1fba89237"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:21.945995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.945972    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-dshm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:21.945995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.945993    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tmp-dir\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:21.946138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.946003    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-model-cache\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:21.946138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.946012    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-home\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:21.946138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.946022    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-tls-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:21.946138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:21.946030    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-765kl\" (UniqueName: \"kubernetes.io/projected/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237-kube-api-access-765kl\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:22.415132 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.415093    2573 generic.go:356] "Generic (PLEG): container finished" podID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" containerID="7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c" exitCode=0
Sep 17 01:52:22.415281 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.415139    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"
Sep 17 01:52:22.415281 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.415173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" event={"ID":"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237","Type":"ContainerDied","Data":"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"}
Sep 17 01:52:22.415281 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.415222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb" event={"ID":"7dfdcf1e-508f-4d6d-94e6-f5f1fba89237","Type":"ContainerDied","Data":"e0c8cfd262934eb24ef2e743984807c862c4d7e66e8c6db387d4ff7b90522973"}
Sep 17 01:52:22.415281 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.415245    2573 scope.go:117] "RemoveContainer" containerID="7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"
Sep 17 01:52:22.424128 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.424109    2573 scope.go:117] "RemoveContainer" containerID="7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"
Sep 17 01:52:22.424469 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:22.424449    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c\": container with ID starting with 7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c not found: ID does not exist" containerID="7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"
Sep 17 01:52:22.424540 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.424480    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c"} err="failed to get container status \"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c\": rpc error: code = NotFound desc = could not find container \"7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c\": container with ID starting with 7664ed25820b95f6a0738ea96406628e16d8b8a5984a9baa59c01b6886ff067c not found: ID does not exist"
Sep 17 01:52:22.436322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.436296    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:52:22.438052 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:22.438033    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-361849/sub-test-model-361849-kserve-f5ff6dcc-nb4nb"]
Sep 17 01:52:23.799390 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:23.799360    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" path="/var/lib/kubelet/pods/7dfdcf1e-508f-4d6d-94e6-f5f1fba89237/volumes"
Sep 17 01:52:24.477057 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:24.477026    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:52:25.655095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:25.655064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:25.755289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:25.755257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:25.906107 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:25.906021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:26.279681 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.279605    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"]
Sep 17 01:52:26.280026 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280011    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" containerName="main"
Sep 17 01:52:26.280083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280028    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" containerName="main"
Sep 17 01:52:26.280083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280045    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c70820f-0397-412f-89c9-23d0f66ce3c6" containerName="payload-pre-processing"
Sep 17 01:52:26.280083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280050    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c70820f-0397-412f-89c9-23d0f66ce3c6" containerName="payload-pre-processing"
Sep 17 01:52:26.280083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280065    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fac06a0-206b-439a-ab41-32b022d66cb9" containerName="revoke-keys"
Sep 17 01:52:26.280083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280071    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fac06a0-206b-439a-ab41-32b022d66cb9" containerName="revoke-keys"
Sep 17 01:52:26.280245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280130    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fac06a0-206b-439a-ab41-32b022d66cb9" containerName="revoke-keys"
Sep 17 01:52:26.280245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280137    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c70820f-0397-412f-89c9-23d0f66ce3c6" containerName="payload-pre-processing"
Sep 17 01:52:26.280245 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.280143    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfdcf1e-508f-4d6d-94e6-f5f1fba89237" containerName="main"
Sep 17 01:52:26.284015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.283995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:26.287678 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.287659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:52:26.296855 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.296828    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"]
Sep 17 01:52:26.384406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.384372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c\" (UID: \"8c13faa7-241a-472f-8873-eb4bb5ecd247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:26.485416 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.485384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c\" (UID: \"8c13faa7-241a-472f-8873-eb4bb5ecd247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:26.485978 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.485959    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c\" (UID: \"8c13faa7-241a-472f-8873-eb4bb5ecd247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:26.525655 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.525621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:26.593812 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.593701    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:26.868338 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:26.868232    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"]
Sep 17 01:52:26.871244 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:52:26.871215    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c13faa7_241a_472f_8873_eb4bb5ecd247.slice/crio-0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec WatchSource:0}: Error finding container 0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec: Status 404 returned error can't find the container with id 0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec
Sep 17 01:52:27.304854 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:27.304754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:27.444496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:27.444461    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c" event={"ID":"8c13faa7-241a-472f-8873-eb4bb5ecd247","Type":"ContainerStarted","Data":"8ea47faa069db604c9c8faa32c3d64cab74349f558b78be8315bc4de3a7784eb"}
Sep 17 01:52:27.444640 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:27.444531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c" event={"ID":"8c13faa7-241a-472f-8873-eb4bb5ecd247","Type":"ContainerStarted","Data":"0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec"}
Sep 17 01:52:27.460928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:27.460883    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c" podStartSLOduration=1.460868407 podStartE2EDuration="1.460868407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:52:27.458689119 +0000 UTC m=+1846.102797226" watchObservedRunningTime="2026-09-17 01:52:27.460868407 +0000 UTC m=+1846.104976486"
Sep 17 01:52:27.915656 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:27.915624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:28.451621 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:28.451578    2573 generic.go:356] "Generic (PLEG): container finished" podID="8c13faa7-241a-472f-8873-eb4bb5ecd247" containerID="8ea47faa069db604c9c8faa32c3d64cab74349f558b78be8315bc4de3a7784eb" exitCode=0
Sep 17 01:52:28.451851 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:28.451653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c" event={"ID":"8c13faa7-241a-472f-8873-eb4bb5ecd247","Type":"ContainerDied","Data":"8ea47faa069db604c9c8faa32c3d64cab74349f558b78be8315bc4de3a7784eb"}
Sep 17 01:52:28.793311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:28.793220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:29.432714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:29.432667    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:29.596434 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:29.596411    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:29.716044 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:29.715968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca\") pod \"8c13faa7-241a-472f-8873-eb4bb5ecd247\" (UID: \"8c13faa7-241a-472f-8873-eb4bb5ecd247\") "
Sep 17 01:52:29.716311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:29.716292    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c13faa7-241a-472f-8873-eb4bb5ecd247" (UID: "8c13faa7-241a-472f-8873-eb4bb5ecd247"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:29.817514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:29.817489    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c13faa7-241a-472f-8873-eb4bb5ecd247-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:30.464322 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:30.464281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c" event={"ID":"8c13faa7-241a-472f-8873-eb4bb5ecd247","Type":"ContainerDied","Data":"0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec"}
Sep 17 01:52:30.464705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:30.464342    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d5aad2a626ae28fbb510e77a8b2dcd14541b2e876122e1f1bbc3552e4bb74ec"
Sep 17 01:52:30.464705 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:30.464306    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"
Sep 17 01:52:36.705165 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.705133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:36.726282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.726246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:52:36.726613 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.726582    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" podUID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" containerName="payload-processing" containerID="cri-o://203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb" gracePeriod=30
Sep 17 01:52:36.730411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.730375    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:52:36.730766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.730738    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" podUID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" containerName="payload-pre-processing" containerID="cri-o://bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7" gracePeriod=30
Sep 17 01:52:36.763455 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.763397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:36.826480 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.826450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:36.869937 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.869901    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"]
Sep 17 01:52:36.872753 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.872722    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-725559-bgq9c"]
Sep 17 01:52:36.889320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:36.889276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:37.011021 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.010994    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:52:37.027791 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.027742    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:52:37.180600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.180564    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume\") pod \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") "
Sep 17 01:52:37.180821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.180648    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume\") pod \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") "
Sep 17 01:52:37.180821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.180748    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhmrb\" (UniqueName: \"kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb\") pod \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\" (UID: \"eb9b8cc7-defb-4d57-8c8a-ab6727786b34\") "
Sep 17 01:52:37.180821 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.180813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx\") pod \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\" (UID: \"ec48470b-dce6-4d34-8cb8-a5d96e80a307\") "
Sep 17 01:52:37.181043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.181017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb9b8cc7-defb-4d57-8c8a-ab6727786b34" (UID: "eb9b8cc7-defb-4d57-8c8a-ab6727786b34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:37.181108 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.181034    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec48470b-dce6-4d34-8cb8-a5d96e80a307" (UID: "ec48470b-dce6-4d34-8cb8-a5d96e80a307"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:37.182781 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.182750    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb" (OuterVolumeSpecName: "kube-api-access-vhmrb") pod "eb9b8cc7-defb-4d57-8c8a-ab6727786b34" (UID: "eb9b8cc7-defb-4d57-8c8a-ab6727786b34"). InnerVolumeSpecName "kube-api-access-vhmrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:37.182855 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.182784    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx" (OuterVolumeSpecName: "kube-api-access-r76lx") pod "ec48470b-dce6-4d34-8cb8-a5d96e80a307" (UID: "ec48470b-dce6-4d34-8cb8-a5d96e80a307"). InnerVolumeSpecName "kube-api-access-r76lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:37.241327 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.241253    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:37.281515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.281481    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/ec48470b-dce6-4d34-8cb8-a5d96e80a307-kube-api-access-r76lx\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:37.281515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.281511    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:37.281515 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.281521    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec48470b-dce6-4d34-8cb8-a5d96e80a307-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:37.281740 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.281529    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhmrb\" (UniqueName: \"kubernetes.io/projected/eb9b8cc7-defb-4d57-8c8a-ab6727786b34-kube-api-access-vhmrb\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:37.317295 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.317268    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:37.499082 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.498994    2573 generic.go:356] "Generic (PLEG): container finished" podID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" containerID="bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7" exitCode=0
Sep 17 01:52:37.499082 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.499048    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"
Sep 17 01:52:37.499300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.499087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" event={"ID":"ec48470b-dce6-4d34-8cb8-a5d96e80a307","Type":"ContainerDied","Data":"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"}
Sep 17 01:52:37.499300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.499149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz" event={"ID":"ec48470b-dce6-4d34-8cb8-a5d96e80a307","Type":"ContainerDied","Data":"2cf08343c36a55a6bb25249481b42fcb6883e6b3e2d80a98b2def6ac977d1340"}
Sep 17 01:52:37.499300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.499165    2573 scope.go:117] "RemoveContainer" containerID="bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"
Sep 17 01:52:37.500586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.500558    2573 generic.go:356] "Generic (PLEG): container finished" podID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" containerID="203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb" exitCode=0
Sep 17 01:52:37.500699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.500612    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" event={"ID":"eb9b8cc7-defb-4d57-8c8a-ab6727786b34","Type":"ContainerDied","Data":"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"}
Sep 17 01:52:37.500699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.500671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977" event={"ID":"eb9b8cc7-defb-4d57-8c8a-ab6727786b34","Type":"ContainerDied","Data":"74d3028c3d928b979040ceef9fbabe9627c784a575fa57b618a3460f3c9edf7d"}
Sep 17 01:52:37.500699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.500621    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"
Sep 17 01:52:37.509697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.509610    2573 scope.go:117] "RemoveContainer" containerID="bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"
Sep 17 01:52:37.509987 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:37.509964    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7\": container with ID starting with bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7 not found: ID does not exist" containerID="bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"
Sep 17 01:52:37.510101 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.509994    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7"} err="failed to get container status \"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7\": rpc error: code = NotFound desc = could not find container \"bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7\": container with ID starting with bb73f1fb54ae4f0552c302a9a672df3c22d94561a9aef081f04494c77e281df7 not found: ID does not exist"
Sep 17 01:52:37.510101 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.510012    2573 scope.go:117] "RemoveContainer" containerID="203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"
Sep 17 01:52:37.518378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.518362    2573 scope.go:117] "RemoveContainer" containerID="203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"
Sep 17 01:52:37.518673 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:37.518654    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb\": container with ID starting with 203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb not found: ID does not exist" containerID="203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"
Sep 17 01:52:37.518743 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.518679    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb"} err="failed to get container status \"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb\": rpc error: code = NotFound desc = could not find container \"203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb\": container with ID starting with 203e34892b52f48e9a2e6ce6842c57622857be08ce997e19479f2d3d35f00ffb not found: ID does not exist"
Sep 17 01:52:37.524786 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.524745    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:52:37.527825 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.527805    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz"]
Sep 17 01:52:37.537287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.537262    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:52:37.546411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.546374    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977"]
Sep 17 01:52:37.799693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.799610    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c13faa7-241a-472f-8873-eb4bb5ecd247" path="/var/lib/kubelet/pods/8c13faa7-241a-472f-8873-eb4bb5ecd247/volumes"
Sep 17 01:52:37.800072 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.800020    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" path="/var/lib/kubelet/pods/eb9b8cc7-defb-4d57-8c8a-ab6727786b34/volumes"
Sep 17 01:52:37.800335 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:37.800321    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" path="/var/lib/kubelet/pods/ec48470b-dce6-4d34-8cb8-a5d96e80a307/volumes"
Sep 17 01:52:38.002462 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:38.002432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:38.643378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:38.643347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:40.679804 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:40.678512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:52:42.131733 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:42.131701    2573 scope.go:117] "RemoveContainer" containerID="5cee50a379d4016c8304b324d62e0ef6acecc31b022a0cf5bfc04fcd7e73f0f7"
Sep 17 01:52:42.938956 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:42.938926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:43.004866 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.004838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:43.162793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.162736    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:52:43.163266 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.162980    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" containerID="cri-o://258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18" gracePeriod=30
Sep 17 01:52:43.182839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.182803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:43.283039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.282943    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:52:43.283217 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:43.283030    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:52:44.169238 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:44.169195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:52:48.401507 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.401475    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:52:48.478747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478680    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478723    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478747 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwph2\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478795    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478854    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.478999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.478989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert\") pod \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\" (UID: \"3f1c16e6-db92-467d-bd6e-17c2bc2a7073\") "
Sep 17 01:52:48.479286 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479153    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:48.479339 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479285    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:48.479400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479331    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.479450 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479413    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:52:48.479503 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:48.479558 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.479542    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:48.481036 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.481009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:52:48.481138 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.481084    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2" (OuterVolumeSpecName: "kube-api-access-qwph2") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "kube-api-access-qwph2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:48.481305 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.481282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:52:48.481400 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.481283    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f1c16e6-db92-467d-bd6e-17c2bc2a7073" (UID: "3f1c16e6-db92-467d-bd6e-17c2bc2a7073"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:52:48.561304 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.561266    2573 generic.go:356] "Generic (PLEG): container finished" podID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerID="258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18" exitCode=0
Sep 17 01:52:48.561460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.561324    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"
Sep 17 01:52:48.561460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.561353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerDied","Data":"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"}
Sep 17 01:52:48.561460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.561409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf" event={"ID":"3f1c16e6-db92-467d-bd6e-17c2bc2a7073","Type":"ContainerDied","Data":"1122145ce43577ff4c2f110991e09a5244e04bb52e16da7e2005f3f37aa60d08"}
Sep 17 01:52:48.561460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.561433    2573 scope.go:117] "RemoveContainer" containerID="258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"
Sep 17 01:52:48.570898 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.570877    2573 scope.go:117] "RemoveContainer" containerID="463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"
Sep 17 01:52:48.579085 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579068    2573 scope.go:117] "RemoveContainer" containerID="258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"
Sep 17 01:52:48.579335 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:48.579317    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18\": container with ID starting with 258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18 not found: ID does not exist" containerID="258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"
Sep 17 01:52:48.579394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579343    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18"} err="failed to get container status \"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18\": rpc error: code = NotFound desc = could not find container \"258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18\": container with ID starting with 258a3937f6c8fdfb1be33411c23a09f6fe051580c316df2f51b80e60cb79dd18 not found: ID does not exist"
Sep 17 01:52:48.579394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579359    2573 scope.go:117] "RemoveContainer" containerID="463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"
Sep 17 01:52:48.579569 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:52:48.579551    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13\": container with ID starting with 463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13 not found: ID does not exist" containerID="463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"
Sep 17 01:52:48.579670 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579570    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13"} err="failed to get container status \"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13\": rpc error: code = NotFound desc = could not find container \"463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13\": container with ID starting with 463d61f70e46492e6188cc9be3731cb50ed24c67fcf269e796766ea2c6525a13 not found: ID does not exist"
Sep 17 01:52:48.579823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579806    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579825    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579834    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579842    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwph2\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-kube-api-access-qwph2\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579850    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579859    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.579871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579867    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.580099 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.579875    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f1c16e6-db92-467d-bd6e-17c2bc2a7073-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:52:48.582645 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.582622    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:52:48.586714 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:48.586691    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf"]
Sep 17 01:52:49.799037 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:49.799006    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" path="/var/lib/kubelet/pods/3f1c16e6-db92-467d-bd6e-17c2bc2a7073/volumes"
Sep 17 01:52:53.266820 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:52:53.266784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:53:05.617210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:05.617102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:05.717891 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:05.717861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:08.980936 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:08.980903    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:53:18.286393 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:18.286352    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:53:21.494123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:21.494090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:23.813272 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:23.813238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:23.914258 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:23.914220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:24.687644 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:24.687612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:25.693311 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:25.693274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:26.107594 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:26.107564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:26.386543 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:26.386468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:26.737378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:26.737302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:28.709310 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:28.709273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:29.395527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:29.395493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:29.483372 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:29.483339    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:53:29.485374 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:29.485348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:29.665724 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:29.665625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:30.312974 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:30.312940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:31.168061 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:31.168025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:31.269103 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:31.269067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:31.606078 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:31.606037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:31.703493 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:31.703460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:39.465662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:39.465624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:53:42.168232 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:42.168204    2573 scope.go:117] "RemoveContainer" containerID="f0a8d87f9a45189a6bb4ab4f72c5ebea6edcaf24b1cbe9b496f0d60ff9df6293"
Sep 17 01:53:52.904928 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:52.904886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:53.681377 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:53.681343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:54.197522 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:54.197487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:54.346723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:54.346686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:54.826370 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:54.826333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:54.983648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:54.983617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:55.286438 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:55.286399    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:55.375223 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:55.375188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:57.902956 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:57.902924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:58.623256 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:58.623226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:58.724041 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:58.724008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:53:59.284066 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:53:59.284031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:00.099486 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:00.099451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:00.872210 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:00.872179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:00.972641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:00.972608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:01.072875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.072846    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:01.313209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.313133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:01.414196 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.414168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:01.415000 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.414979    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:54:01.415371 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415359    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c13faa7-241a-472f-8873-eb4bb5ecd247" containerName="revoke-keys"
Sep 17 01:54:01.415413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415373    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c13faa7-241a-472f-8873-eb4bb5ecd247" containerName="revoke-keys"
Sep 17 01:54:01.415413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415389    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.415413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415395    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.415413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415407    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" containerName="payload-processing"
Sep 17 01:54:01.415413 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415413    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" containerName="payload-processing"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415421    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415426    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415435    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" containerName="payload-pre-processing"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415440    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" containerName="payload-pre-processing"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415497    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c13faa7-241a-472f-8873-eb4bb5ecd247" containerName="revoke-keys"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415505    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec48470b-dce6-4d34-8cb8-a5d96e80a307" containerName="payload-pre-processing"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415513    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9b8cc7-defb-4d57-8c8a-ab6727786b34" containerName="payload-processing"
Sep 17 01:54:01.415566 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.415525    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c16e6-db92-467d-bd6e-17c2bc2a7073" containerName="istio-proxy"
Sep 17 01:54:01.418407 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.418384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.420843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.420822    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-29e19c-dockercfg-585nc\""
Sep 17 01:54:01.420967 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.420953    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-29e19c\""
Sep 17 01:54:01.428332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.428307    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:54:01.438290 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.438265    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:54:01.441922 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.441898    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.451094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.451068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:54:01.512475 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.512443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq7p5\" (UniqueName: \"kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.512666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.512483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.512666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.512531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.512666 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.512569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b9b\" (UniqueName: \"kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.613625 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.613590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b9b\" (UniqueName: \"kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.613811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.613661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq7p5\" (UniqueName: \"kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.613811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.613689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.613811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.613731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.614482 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.614444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.614528 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.614442    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.621797 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.621759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq7p5\" (UniqueName: \"kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5\") pod \"payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.621917 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.621853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b9b\" (UniqueName: \"kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b\") pod \"payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:01.729116 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.729086    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:01.752320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:01.752297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:02.001823 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.001569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:54:02.004223 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:54:02.004190    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf358d162_9612_4301_aaf4_fef96b4472d4.slice/crio-f3f34ef38d93c501171c86b312edb4a841fd5d8e7d2e740e22923bcfd4c7fd24 WatchSource:0}: Error finding container f3f34ef38d93c501171c86b312edb4a841fd5d8e7d2e740e22923bcfd4c7fd24: Status 404 returned error can't find the container with id f3f34ef38d93c501171c86b312edb4a841fd5d8e7d2e740e22923bcfd4c7fd24
Sep 17 01:54:02.034809 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.034784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:54:02.038928 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:54:02.038902    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935063bf_193e_47a9_a4e9_66caae24a5c8.slice/crio-a964d07246d3be85218c9ffcba3406d8e9e65dd5daf8f7da966a9530547cafaf WatchSource:0}: Error finding container a964d07246d3be85218c9ffcba3406d8e9e65dd5daf8f7da966a9530547cafaf: Status 404 returned error can't find the container with id a964d07246d3be85218c9ffcba3406d8e9e65dd5daf8f7da966a9530547cafaf
Sep 17 01:54:02.926618 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.926582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" event={"ID":"935063bf-193e-47a9-a4e9-66caae24a5c8","Type":"ContainerStarted","Data":"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"}
Sep 17 01:54:02.926828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.926633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" event={"ID":"935063bf-193e-47a9-a4e9-66caae24a5c8","Type":"ContainerStarted","Data":"a964d07246d3be85218c9ffcba3406d8e9e65dd5daf8f7da966a9530547cafaf"}
Sep 17 01:54:02.926828 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.926681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:02.928276 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.928249    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" event={"ID":"f358d162-9612-4301-aaf4-fef96b4472d4","Type":"ContainerStarted","Data":"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"}
Sep 17 01:54:02.928384 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.928289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" event={"ID":"f358d162-9612-4301-aaf4-fef96b4472d4","Type":"ContainerStarted","Data":"f3f34ef38d93c501171c86b312edb4a841fd5d8e7d2e740e22923bcfd4c7fd24"}
Sep 17 01:54:02.928384 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.928312    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:02.942630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.942582    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" podStartSLOduration=1.942568209 podStartE2EDuration="1.942568209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:54:02.941601934 +0000 UTC m=+1941.585710029" watchObservedRunningTime="2026-09-17 01:54:02.942568209 +0000 UTC m=+1941.586676287"
Sep 17 01:54:02.956151 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:02.956114    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" podStartSLOduration=1.956104571 podStartE2EDuration="1.956104571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:54:02.955763408 +0000 UTC m=+1941.599871504" watchObservedRunningTime="2026-09-17 01:54:02.956104571 +0000 UTC m=+1941.600212650"
Sep 17 01:54:03.178841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:03.178749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:06.478583 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:06.478540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:54:10.061532 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:10.061497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:13.937816 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:13.937786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:54:13.938282 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:13.937918    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:54:22.554572 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:22.554536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:23.759155 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:23.759119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:24.281432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:24.281398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:24.998064 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:24.998030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:25.624119 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:25.624076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:26.381131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:26.381094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:28.635923 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:28.635886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:33.892688 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:33.892653    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b_935063bf-193e-47a9-a4e9-66caae24a5c8/payload-processing/0.log"
Sep 17 01:54:38.892836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:38.892800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:54:42.189615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:42.189583    2573 scope.go:117] "RemoveContainer" containerID="c4122ea056974eb61a819addb09f0ffbd76676fa8994a76a91e802b696234349"
Sep 17 01:54:42.970126 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:54:42.970088    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:55:03.574796 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:03.574737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:55:10.344505 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:10.344471    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b_935063bf-193e-47a9-a4e9-66caae24a5c8/payload-processing/0.log"
Sep 17 01:55:10.463269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:10.463241    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b_935063bf-193e-47a9-a4e9-66caae24a5c8/payload-processing/0.log"
Sep 17 01:55:10.758087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:10.758056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:11.052689 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:11.052613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:11.508803 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:11.508756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:13.381191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:13.381153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:13.924409 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:13.924375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:14.034346 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:14.034312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:14.125567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:14.125538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:14.813514 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:14.813473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:15.553167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:15.553129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:16.168137 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:16.168099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:16.927246 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:16.927216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:17.028496 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.028462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:17.315148 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.315064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:17.415464 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.415436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:17.466211 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.466181    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:17.469711 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.469691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.471984 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.471956    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cb9976\""
Sep 17 01:55:17.480983 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.480961    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:17.481674 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.481655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:17.568270 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.568197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96g9h\" (UniqueName: \"kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.568401 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.568274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.669047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.669010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96g9h\" (UniqueName: \"kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.669047 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.669055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.669723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.669702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.676637 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.676610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96g9h\" (UniqueName: \"kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h\") pod \"payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:17.780329 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:17.780292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:18.053161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:18.052528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:18.057557 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:55:18.057529    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dee2b3_6e65_49dc_998d_3dd13465d295.slice/crio-4786ee8bb19f8b9a34d0247b0e5954e59e49700e9618502ff3dcbf27677b96a5 WatchSource:0}: Error finding container 4786ee8bb19f8b9a34d0247b0e5954e59e49700e9618502ff3dcbf27677b96a5: Status 404 returned error can't find the container with id 4786ee8bb19f8b9a34d0247b0e5954e59e49700e9618502ff3dcbf27677b96a5
Sep 17 01:55:18.287055 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:18.287014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" event={"ID":"36dee2b3-6e65-49dc-998d-3dd13465d295","Type":"ContainerStarted","Data":"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"}
Sep 17 01:55:18.287258 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:18.287071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" event={"ID":"36dee2b3-6e65-49dc-998d-3dd13465d295","Type":"ContainerStarted","Data":"4786ee8bb19f8b9a34d0247b0e5954e59e49700e9618502ff3dcbf27677b96a5"}
Sep 17 01:55:18.287258 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:18.287116    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:18.304667 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:18.304617    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" podStartSLOduration=1.304603641 podStartE2EDuration="1.304603641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:18.303094287 +0000 UTC m=+2016.947202378" watchObservedRunningTime="2026-09-17 01:55:18.304603641 +0000 UTC m=+2016.948711719"
Sep 17 01:55:22.675054 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:22.675019    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:55:29.293523 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:29.293492    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:31.967293 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:31.967250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:37.747091 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:37.747051    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:39.065765 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.065720    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:39.162746 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.162713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:39.790167 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.790132    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"]
Sep 17 01:55:39.793883 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.793861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:39.798326 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.798300    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:55:39.806641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.806618    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"]
Sep 17 01:55:39.818378 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.818354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:39.864698 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.864488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj\" (UID: \"ba70278d-3346-44f5-9ef8-2562d31b4470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:39.965446 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.965414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj\" (UID: \"ba70278d-3346-44f5-9ef8-2562d31b4470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:39.966191 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:39.966159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj\" (UID: \"ba70278d-3346-44f5-9ef8-2562d31b4470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:40.104126 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:40.104103    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:40.370570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:40.370545    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"]
Sep 17 01:55:40.372592 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:55:40.372559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba70278d_3346_44f5_9ef8_2562d31b4470.slice/crio-2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0 WatchSource:0}: Error finding container 2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0: Status 404 returned error can't find the container with id 2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0
Sep 17 01:55:40.395116 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:40.395076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj" event={"ID":"ba70278d-3346-44f5-9ef8-2562d31b4470","Type":"ContainerStarted","Data":"2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0"}
Sep 17 01:55:40.594488 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:40.594458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:41.376954 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:41.376863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:41.401831 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:41.401798    2573 generic.go:356] "Generic (PLEG): container finished" podID="ba70278d-3346-44f5-9ef8-2562d31b4470" containerID="c28dcc19d1026cc6a2e99d47f7ad3171f8bf476ebb22760b2c4ef51fe3035361" exitCode=0
Sep 17 01:55:41.401995 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:41.401916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj" event={"ID":"ba70278d-3346-44f5-9ef8-2562d31b4470","Type":"ContainerDied","Data":"c28dcc19d1026cc6a2e99d47f7ad3171f8bf476ebb22760b2c4ef51fe3035361"}
Sep 17 01:55:42.116684 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.116651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:42.210427 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.210381    2573 scope.go:117] "RemoveContainer" containerID="51cad6e33678e7ed8b1b114416c9c12f9c0164a85f39d1d3d0d2a313fe6815ca"
Sep 17 01:55:42.548841 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.548817    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:42.686163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.686078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:42.692087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.692061    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca\") pod \"ba70278d-3346-44f5-9ef8-2562d31b4470\" (UID: \"ba70278d-3346-44f5-9ef8-2562d31b4470\") "
Sep 17 01:55:42.692367 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.692344    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba70278d-3346-44f5-9ef8-2562d31b4470" (UID: "ba70278d-3346-44f5-9ef8-2562d31b4470"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:55:42.793244 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:42.793208    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba70278d-3346-44f5-9ef8-2562d31b4470-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:55:43.413458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:43.413424    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"
Sep 17 01:55:43.413458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:43.413449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj" event={"ID":"ba70278d-3346-44f5-9ef8-2562d31b4470","Type":"ContainerDied","Data":"2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0"}
Sep 17 01:55:43.413720 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:43.413491    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2da5c988c66fe3566e0c112d730c98f6959a12bd25b05c530653efb478547bd0"
Sep 17 01:55:43.414570 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:43.414550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:44.037798 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:44.037748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:45.316941 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:45.316890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:45.944624 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:45.944583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:45.966038 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:45.966004    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:45.966234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:45.966209    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" podUID="36dee2b3-6e65-49dc-998d-3dd13465d295" containerName="payload-pre-processing" containerID="cri-o://5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5" gracePeriod=30
Sep 17 01:55:46.042626 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.042593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:46.116463 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.116427    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"]
Sep 17 01:55:46.118684 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.118657    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cb9976-fcdqj"]
Sep 17 01:55:46.119093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.119067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:46.182940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.182908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:46.217701 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.217669    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:46.325735 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.325700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96g9h\" (UniqueName: \"kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h\") pod \"36dee2b3-6e65-49dc-998d-3dd13465d295\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") "
Sep 17 01:55:46.326220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.325799    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume\") pod \"36dee2b3-6e65-49dc-998d-3dd13465d295\" (UID: \"36dee2b3-6e65-49dc-998d-3dd13465d295\") "
Sep 17 01:55:46.326220 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.326103    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36dee2b3-6e65-49dc-998d-3dd13465d295" (UID: "36dee2b3-6e65-49dc-998d-3dd13465d295"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:55:46.328012 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.327980    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h" (OuterVolumeSpecName: "kube-api-access-96g9h") pod "36dee2b3-6e65-49dc-998d-3dd13465d295" (UID: "36dee2b3-6e65-49dc-998d-3dd13465d295"). InnerVolumeSpecName "kube-api-access-96g9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:55:46.426899 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.426866    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96g9h\" (UniqueName: \"kubernetes.io/projected/36dee2b3-6e65-49dc-998d-3dd13465d295-kube-api-access-96g9h\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:55:46.426899 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.426892    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36dee2b3-6e65-49dc-998d-3dd13465d295-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:55:46.430320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.430286    2573 generic.go:356] "Generic (PLEG): container finished" podID="36dee2b3-6e65-49dc-998d-3dd13465d295" containerID="5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5" exitCode=0
Sep 17 01:55:46.430460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.430337    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"
Sep 17 01:55:46.430460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.430367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" event={"ID":"36dee2b3-6e65-49dc-998d-3dd13465d295","Type":"ContainerDied","Data":"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"}
Sep 17 01:55:46.430460 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.430452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p" event={"ID":"36dee2b3-6e65-49dc-998d-3dd13465d295","Type":"ContainerDied","Data":"4786ee8bb19f8b9a34d0247b0e5954e59e49700e9618502ff3dcbf27677b96a5"}
Sep 17 01:55:46.430607 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.430474    2573 scope.go:117] "RemoveContainer" containerID="5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"
Sep 17 01:55:46.439761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.439742    2573 scope.go:117] "RemoveContainer" containerID="5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"
Sep 17 01:55:46.440061 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:55:46.440042    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5\": container with ID starting with 5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5 not found: ID does not exist" containerID="5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"
Sep 17 01:55:46.440117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.440068    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5"} err="failed to get container status \"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5\": rpc error: code = NotFound desc = could not find container \"5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5\": container with ID starting with 5476ebb940f8ee9a531a87bd2c629fce75e53c13a9e758fe44a43bd84b9043f5 not found: ID does not exist"
Sep 17 01:55:46.453764 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.453699    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:46.457045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.457024    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p"]
Sep 17 01:55:46.460761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.460744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:46.518840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:46.518815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:47.401174 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:47.401143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:47.798832 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:47.798742    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36dee2b3-6e65-49dc-998d-3dd13465d295" path="/var/lib/kubelet/pods/36dee2b3-6e65-49dc-998d-3dd13465d295/volumes"
Sep 17 01:55:47.799112 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:47.799097    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba70278d-3346-44f5-9ef8-2562d31b4470" path="/var/lib/kubelet/pods/ba70278d-3346-44f5-9ef8-2562d31b4470/volumes"
Sep 17 01:55:48.392305 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:48.392273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:49.207630 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:49.207599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:49.844448 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:49.844417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:50.371052 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:50.371017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:55:52.267262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:52.267207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:52.371374 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:52.371337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:52.555761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:52.555671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:56.177586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.177549    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"]
Sep 17 01:55:56.177990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.177931    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba70278d-3346-44f5-9ef8-2562d31b4470" containerName="revoke-keys"
Sep 17 01:55:56.177990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.177943    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba70278d-3346-44f5-9ef8-2562d31b4470" containerName="revoke-keys"
Sep 17 01:55:56.177990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.177964    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36dee2b3-6e65-49dc-998d-3dd13465d295" containerName="payload-pre-processing"
Sep 17 01:55:56.177990 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.177970    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="36dee2b3-6e65-49dc-998d-3dd13465d295" containerName="payload-pre-processing"
Sep 17 01:55:56.178123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.178017    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba70278d-3346-44f5-9ef8-2562d31b4470" containerName="revoke-keys"
Sep 17 01:55:56.178123 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.178026    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="36dee2b3-6e65-49dc-998d-3dd13465d295" containerName="payload-pre-processing"
Sep 17 01:55:56.182050 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.182033    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:56.184713 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.184683    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:55:56.187924 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.187893    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"]
Sep 17 01:55:56.310122 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.310091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4\" (UID: \"2fcf01a6-98ca-448d-b56f-40e03dd5e187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:56.410675 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.410641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4\" (UID: \"2fcf01a6-98ca-448d-b56f-40e03dd5e187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:56.411300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.411272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4\" (UID: \"2fcf01a6-98ca-448d-b56f-40e03dd5e187\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:56.490700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.490625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:56.492555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.492534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:56.760063 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:56.760037    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"]
Sep 17 01:55:56.762392 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:55:56.762344    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcf01a6_98ca_448d_b56f_40e03dd5e187.slice/crio-db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f WatchSource:0}: Error finding container db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f: Status 404 returned error can't find the container with id db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f
Sep 17 01:55:57.149406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:57.149372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:57.487835 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:57.487800    2573 generic.go:356] "Generic (PLEG): container finished" podID="2fcf01a6-98ca-448d-b56f-40e03dd5e187" containerID="8023bcaf8b09be358fd2837915450c388685ba8b2ecc46058bf123446407f7c1" exitCode=0
Sep 17 01:55:57.488146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:57.487868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4" event={"ID":"2fcf01a6-98ca-448d-b56f-40e03dd5e187","Type":"ContainerDied","Data":"8023bcaf8b09be358fd2837915450c388685ba8b2ecc46058bf123446407f7c1"}
Sep 17 01:55:57.488146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:57.487950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4" event={"ID":"2fcf01a6-98ca-448d-b56f-40e03dd5e187","Type":"ContainerStarted","Data":"db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f"}
Sep 17 01:55:57.896017 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:57.895984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:58.463540 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:58.463507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:58.634527 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:58.634499    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:58.735303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:58.735238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca\") pod \"2fcf01a6-98ca-448d-b56f-40e03dd5e187\" (UID: \"2fcf01a6-98ca-448d-b56f-40e03dd5e187\") "
Sep 17 01:55:58.735572 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:58.735551    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fcf01a6-98ca-448d-b56f-40e03dd5e187" (UID: "2fcf01a6-98ca-448d-b56f-40e03dd5e187"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:55:58.836152 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:58.836127    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcf01a6-98ca-448d-b56f-40e03dd5e187-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:55:59.269429 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:59.269396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:55:59.498715 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:59.498682    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"
Sep 17 01:55:59.498896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:59.498721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4" event={"ID":"2fcf01a6-98ca-448d-b56f-40e03dd5e187","Type":"ContainerDied","Data":"db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f"}
Sep 17 01:55:59.498896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:55:59.498763    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db01355a5cfffcc6062de2ef7fc1e1fb242ce1aeca817125937f3a62b346bd4f"
Sep 17 01:56:00.231234 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:00.231175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:09.213289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:09.213212    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:56:11.718751 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.718711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:11.777855 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.777810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:11.837094 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.837064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:11.890043 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.890006    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"]
Sep 17 01:56:11.893648 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.893618    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-647268-n8mx4"]
Sep 17 01:56:11.895079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:11.895057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:12.260058 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:12.260018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:12.360269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:12.360234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:12.930672 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:12.930641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:13.640489 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:13.640448    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:13.798811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:13.798760    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcf01a6-98ca-448d-b56f-40e03dd5e187" path="/var/lib/kubelet/pods/2fcf01a6-98ca-448d-b56f-40e03dd5e187/volumes"
Sep 17 01:56:14.411264 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:14.411223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:17.079412 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:17.079382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:17.179763 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:17.179728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:17.291071 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:17.291043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:21.767811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:21.767761    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:56:36.232615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:36.232580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:37.342009 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:37.341973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:42.762331 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:42.762297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:48.230840 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.230802    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:48.331615 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.331582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:48.516268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.516190    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:48.878761 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.878725    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"]
Sep 17 01:56:48.879117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.879104    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcf01a6-98ca-448d-b56f-40e03dd5e187" containerName="revoke-keys"
Sep 17 01:56:48.879163 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.879119    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcf01a6-98ca-448d-b56f-40e03dd5e187" containerName="revoke-keys"
Sep 17 01:56:48.879203 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.879184    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcf01a6-98ca-448d-b56f-40e03dd5e187" containerName="revoke-keys"
Sep 17 01:56:48.882262 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.882239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:48.884766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.884745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:56:48.890201 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:48.889730    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"]
Sep 17 01:56:49.070410 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.070369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9\" (UID: \"c64f8880-35cf-43c2-aec5-2f1a8957bd42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:49.162837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.162725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:49.170947 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.170920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9\" (UID: \"c64f8880-35cf-43c2-aec5-2f1a8957bd42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:49.171586 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.171563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9\" (UID: \"c64f8880-35cf-43c2-aec5-2f1a8957bd42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:49.194100 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.194078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:49.466324 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.466234    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"]
Sep 17 01:56:49.468674 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:56:49.468645    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64f8880_35cf_43c2_aec5_2f1a8957bd42.slice/crio-e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc WatchSource:0}: Error finding container e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc: Status 404 returned error can't find the container with id e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc
Sep 17 01:56:49.748131 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.748095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9" event={"ID":"c64f8880-35cf-43c2-aec5-2f1a8957bd42","Type":"ContainerStarted","Data":"5beec6a77c04ff04b2f030760d01c63870a5eb723faf1950ca4982054b9e074a"}
Sep 17 01:56:49.748250 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.748147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9" event={"ID":"c64f8880-35cf-43c2-aec5-2f1a8957bd42","Type":"ContainerStarted","Data":"e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc"}
Sep 17 01:56:49.763548 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.763504    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9" podStartSLOduration=1.763489865 podStartE2EDuration="1.763489865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:56:49.762185856 +0000 UTC m=+2108.406293964" watchObservedRunningTime="2026-09-17 01:56:49.763489865 +0000 UTC m=+2108.407597944"
Sep 17 01:56:49.910092 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:49.910030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:50.583268 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:50.583168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:50.755453 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:50.755421    2573 generic.go:356] "Generic (PLEG): container finished" podID="c64f8880-35cf-43c2-aec5-2f1a8957bd42" containerID="5beec6a77c04ff04b2f030760d01c63870a5eb723faf1950ca4982054b9e074a" exitCode=0
Sep 17 01:56:50.755622 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:50.755507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9" event={"ID":"c64f8880-35cf-43c2-aec5-2f1a8957bd42","Type":"ContainerDied","Data":"5beec6a77c04ff04b2f030760d01c63870a5eb723faf1950ca4982054b9e074a"}
Sep 17 01:56:51.169766 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:51.169737    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:51.804905 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:51.804872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:51.893916 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:51.893888    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:51.995519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:51.995487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca\") pod \"c64f8880-35cf-43c2-aec5-2f1a8957bd42\" (UID: \"c64f8880-35cf-43c2-aec5-2f1a8957bd42\") "
Sep 17 01:56:51.995868 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:51.995845    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c64f8880-35cf-43c2-aec5-2f1a8957bd42" (UID: "c64f8880-35cf-43c2-aec5-2f1a8957bd42"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:56:52.096940 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:52.096873    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8880-35cf-43c2-aec5-2f1a8957bd42-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:56:52.767079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:52.767049    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"
Sep 17 01:56:52.767242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:52.767078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9" event={"ID":"c64f8880-35cf-43c2-aec5-2f1a8957bd42","Type":"ContainerDied","Data":"e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc"}
Sep 17 01:56:52.767242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:52.767121    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9c1b8df854d5b8de44da83d79c550004ca6bdbf70b050a539674602d7ae1fbc"
Sep 17 01:56:59.352444 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.352408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:59.401849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.401816    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:56:59.402093 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.402054    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" podUID="935063bf-193e-47a9-a4e9-66caae24a5c8" containerName="payload-processing" containerID="cri-o://b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65" gracePeriod=30
Sep 17 01:56:59.411218 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.411190    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:56:59.413807 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.412940    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" podUID="f358d162-9612-4301-aaf4-fef96b4472d4" containerName="payload-pre-processing" containerID="cri-o://cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b" gracePeriod=30
Sep 17 01:56:59.416873 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.416848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:59.477184 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.477151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:59.563646 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.563611    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"]
Sep 17 01:56:59.565949 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.565913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:59.566328 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.566306    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-29e19c-jbpn9"]
Sep 17 01:56:59.632516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.632488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:56:59.663020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.662996    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:56:59.691168 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.691138    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:56:59.760609 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.760573    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7b9b\" (UniqueName: \"kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b\") pod \"935063bf-193e-47a9-a4e9-66caae24a5c8\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") "
Sep 17 01:56:59.760810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.760630    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume\") pod \"935063bf-193e-47a9-a4e9-66caae24a5c8\" (UID: \"935063bf-193e-47a9-a4e9-66caae24a5c8\") "
Sep 17 01:56:59.760810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.760693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume\") pod \"f358d162-9612-4301-aaf4-fef96b4472d4\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") "
Sep 17 01:56:59.760810 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.760739    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq7p5\" (UniqueName: \"kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5\") pod \"f358d162-9612-4301-aaf4-fef96b4472d4\" (UID: \"f358d162-9612-4301-aaf4-fef96b4472d4\") "
Sep 17 01:56:59.761175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.761122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "935063bf-193e-47a9-a4e9-66caae24a5c8" (UID: "935063bf-193e-47a9-a4e9-66caae24a5c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:56:59.761175 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.761157    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f358d162-9612-4301-aaf4-fef96b4472d4" (UID: "f358d162-9612-4301-aaf4-fef96b4472d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:56:59.763039 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.763013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5" (OuterVolumeSpecName: "kube-api-access-lq7p5") pod "f358d162-9612-4301-aaf4-fef96b4472d4" (UID: "f358d162-9612-4301-aaf4-fef96b4472d4"). InnerVolumeSpecName "kube-api-access-lq7p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:56:59.763280 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.763260    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b" (OuterVolumeSpecName: "kube-api-access-f7b9b") pod "935063bf-193e-47a9-a4e9-66caae24a5c8" (UID: "935063bf-193e-47a9-a4e9-66caae24a5c8"). InnerVolumeSpecName "kube-api-access-f7b9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:56:59.803095 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.803062    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c64f8880-35cf-43c2-aec5-2f1a8957bd42" path="/var/lib/kubelet/pods/c64f8880-35cf-43c2-aec5-2f1a8957bd42/volumes"
Sep 17 01:56:59.806641 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.806619    2573 generic.go:356] "Generic (PLEG): container finished" podID="935063bf-193e-47a9-a4e9-66caae24a5c8" containerID="b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65" exitCode=0
Sep 17 01:56:59.806752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.806677    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"
Sep 17 01:56:59.806752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.806709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" event={"ID":"935063bf-193e-47a9-a4e9-66caae24a5c8","Type":"ContainerDied","Data":"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"}
Sep 17 01:56:59.806959 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.806768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b" event={"ID":"935063bf-193e-47a9-a4e9-66caae24a5c8","Type":"ContainerDied","Data":"a964d07246d3be85218c9ffcba3406d8e9e65dd5daf8f7da966a9530547cafaf"}
Sep 17 01:56:59.806959 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.806816    2573 scope.go:117] "RemoveContainer" containerID="b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"
Sep 17 01:56:59.818449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.817576    2573 generic.go:356] "Generic (PLEG): container finished" podID="f358d162-9612-4301-aaf4-fef96b4472d4" containerID="cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b" exitCode=0
Sep 17 01:56:59.818449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.817716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" event={"ID":"f358d162-9612-4301-aaf4-fef96b4472d4","Type":"ContainerDied","Data":"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"}
Sep 17 01:56:59.818449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.817759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b" event={"ID":"f358d162-9612-4301-aaf4-fef96b4472d4","Type":"ContainerDied","Data":"f3f34ef38d93c501171c86b312edb4a841fd5d8e7d2e740e22923bcfd4c7fd24"}
Sep 17 01:56:59.818449 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.817815    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"
Sep 17 01:56:59.826235 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.826215    2573 scope.go:117] "RemoveContainer" containerID="b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"
Sep 17 01:56:59.826554 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:56:59.826528    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65\": container with ID starting with b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65 not found: ID does not exist" containerID="b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"
Sep 17 01:56:59.826632 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.826567    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65"} err="failed to get container status \"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65\": rpc error: code = NotFound desc = could not find container \"b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65\": container with ID starting with b8e07012a8e0cef72f0e35e0ddf8010b32d871e79f0d6ac5a4776f234a660d65 not found: ID does not exist"
Sep 17 01:56:59.826632 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.826593    2573 scope.go:117] "RemoveContainer" containerID="cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"
Sep 17 01:56:59.835587 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.835566    2573 scope.go:117] "RemoveContainer" containerID="cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"
Sep 17 01:56:59.835865 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:56:59.835847    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b\": container with ID starting with cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b not found: ID does not exist" containerID="cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"
Sep 17 01:56:59.835935 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.835870    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b"} err="failed to get container status \"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b\": rpc error: code = NotFound desc = could not find container \"cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b\": container with ID starting with cfcd101b92245259f051e637cc00cd5c567ed1d326c06958f0ad46d92b5a6a8b not found: ID does not exist"
Sep 17 01:56:59.836743 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.836719    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:56:59.840444 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.840423    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b"]
Sep 17 01:56:59.849922 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.849900    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:56:59.853852 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.853831    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b"]
Sep 17 01:56:59.861518 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.861499    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f358d162-9612-4301-aaf4-fef96b4472d4-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:56:59.861579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.861520    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq7p5\" (UniqueName: \"kubernetes.io/projected/f358d162-9612-4301-aaf4-fef96b4472d4-kube-api-access-lq7p5\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:56:59.861579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.861533    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7b9b\" (UniqueName: \"kubernetes.io/projected/935063bf-193e-47a9-a4e9-66caae24a5c8-kube-api-access-f7b9b\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:56:59.861579 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.861541    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935063bf-193e-47a9-a4e9-66caae24a5c8-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:56:59.972076 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:56:59.972005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:00.070762 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:00.070733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:00.658365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:00.658319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:01.182793 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:01.182739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:01.804632 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:01.804600    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935063bf-193e-47a9-a4e9-66caae24a5c8" path="/var/lib/kubelet/pods/935063bf-193e-47a9-a4e9-66caae24a5c8/volumes"
Sep 17 01:57:01.805006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:01.804967    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f358d162-9612-4301-aaf4-fef96b4472d4" path="/var/lib/kubelet/pods/f358d162-9612-4301-aaf4-fef96b4472d4/volumes"
Sep 17 01:57:02.769136 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:02.769101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:57:05.649525 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:05.649481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:05.747706 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:05.747675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:05.916700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:05.916601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:06.262519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262435    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"]
Sep 17 01:57:06.262862 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262846    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f358d162-9612-4301-aaf4-fef96b4472d4" containerName="payload-pre-processing"
Sep 17 01:57:06.262913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262863    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f358d162-9612-4301-aaf4-fef96b4472d4" containerName="payload-pre-processing"
Sep 17 01:57:06.262913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262876    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935063bf-193e-47a9-a4e9-66caae24a5c8" containerName="payload-processing"
Sep 17 01:57:06.262913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262882    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="935063bf-193e-47a9-a4e9-66caae24a5c8" containerName="payload-processing"
Sep 17 01:57:06.262913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262890    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64f8880-35cf-43c2-aec5-2f1a8957bd42" containerName="revoke-keys"
Sep 17 01:57:06.262913 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262896    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64f8880-35cf-43c2-aec5-2f1a8957bd42" containerName="revoke-keys"
Sep 17 01:57:06.263070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262963    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="935063bf-193e-47a9-a4e9-66caae24a5c8" containerName="payload-processing"
Sep 17 01:57:06.263070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262970    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64f8880-35cf-43c2-aec5-2f1a8957bd42" containerName="revoke-keys"
Sep 17 01:57:06.263070 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.262977    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f358d162-9612-4301-aaf4-fef96b4472d4" containerName="payload-pre-processing"
Sep 17 01:57:06.267568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.267551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:06.270699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.270673    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:57:06.271899 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.271871    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"]
Sep 17 01:57:06.318911 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.318870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh\" (UID: \"8d31e704-fb2a-451d-a5b4-3b6e7999eef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:06.419693 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.419660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh\" (UID: \"8d31e704-fb2a-451d-a5b4-3b6e7999eef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:06.420309 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.420284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh\" (UID: \"8d31e704-fb2a-451d-a5b4-3b6e7999eef7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:06.578568 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.578491    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:06.848300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.848274    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"]
Sep 17 01:57:06.850440 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:57:06.850412    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d31e704_fb2a_451d_a5b4_3b6e7999eef7.slice/crio-f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83 WatchSource:0}: Error finding container f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83: Status 404 returned error can't find the container with id f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83
Sep 17 01:57:06.858955 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.858931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh" event={"ID":"8d31e704-fb2a-451d-a5b4-3b6e7999eef7","Type":"ContainerStarted","Data":"f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83"}
Sep 17 01:57:06.982045 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:06.982015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:07.780697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:07.780615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:07.865607 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:07.865571    2573 generic.go:356] "Generic (PLEG): container finished" podID="8d31e704-fb2a-451d-a5b4-3b6e7999eef7" containerID="de9ff30754591b91c4e65b57451b6e7cf41dc8807cd923d0876ebd0d41f5d5b5" exitCode=0
Sep 17 01:57:07.866019 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:07.865634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh" event={"ID":"8d31e704-fb2a-451d-a5b4-3b6e7999eef7","Type":"ContainerDied","Data":"de9ff30754591b91c4e65b57451b6e7cf41dc8807cd923d0876ebd0d41f5d5b5"}
Sep 17 01:57:08.428875 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:08.428837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:08.996471 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:08.996441    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:09.043300 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.043270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca\") pod \"8d31e704-fb2a-451d-a5b4-3b6e7999eef7\" (UID: \"8d31e704-fb2a-451d-a5b4-3b6e7999eef7\") "
Sep 17 01:57:09.043619 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.043591    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d31e704-fb2a-451d-a5b4-3b6e7999eef7" (UID: "8d31e704-fb2a-451d-a5b4-3b6e7999eef7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:09.144832 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.144731    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d31e704-fb2a-451d-a5b4-3b6e7999eef7-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:09.876087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.876062    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"
Sep 17 01:57:09.876087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.876071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh" event={"ID":"8d31e704-fb2a-451d-a5b4-3b6e7999eef7","Type":"ContainerDied","Data":"f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83"}
Sep 17 01:57:09.876258 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:09.876111    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3f9a54b2b862bd80d65506278439595a64e774991fc37784d3227b9101c4e83"
Sep 17 01:57:16.705894 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.705857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:16.728824 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.728794    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:57:16.729042 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.729017    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" podUID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" containerName="payload-processing" containerID="cri-o://485128b478a3da82c19fc7d8148097668c32254e48dbe0f9291dbeea3a8b41fc" gracePeriod=30
Sep 17 01:57:16.737320 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.737295    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:57:16.737561 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.737516    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" podUID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" containerName="payload-pre-processing" containerID="cri-o://7112eb57dc948d96cb786ebf6a4380bea5735fc358c92f7e6e732fb89f8352de" gracePeriod=30
Sep 17 01:57:16.879650 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.879577    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"]
Sep 17 01:57:16.881332 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.881305    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-fcd402-dj4sh"]
Sep 17 01:57:16.920289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.920119    2573 generic.go:356] "Generic (PLEG): container finished" podID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" containerID="485128b478a3da82c19fc7d8148097668c32254e48dbe0f9291dbeea3a8b41fc" exitCode=0
Sep 17 01:57:16.920289 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.920192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" event={"ID":"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad","Type":"ContainerDied","Data":"485128b478a3da82c19fc7d8148097668c32254e48dbe0f9291dbeea3a8b41fc"}
Sep 17 01:57:16.922437 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.922407    2573 generic.go:356] "Generic (PLEG): container finished" podID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" containerID="7112eb57dc948d96cb786ebf6a4380bea5735fc358c92f7e6e732fb89f8352de" exitCode=0
Sep 17 01:57:16.922567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.922462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" event={"ID":"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa","Type":"ContainerDied","Data":"7112eb57dc948d96cb786ebf6a4380bea5735fc358c92f7e6e732fb89f8352de"}
Sep 17 01:57:16.999662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:16.999637    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:57:17.019458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.019430    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:57:17.115267 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115231    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume\") pod \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") "
Sep 17 01:57:17.115432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115277    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tlts\" (UniqueName: \"kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts\") pod \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") "
Sep 17 01:57:17.115432 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tffx\" (UniqueName: \"kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx\") pod \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\" (UID: \"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad\") "
Sep 17 01:57:17.115531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115475    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume\") pod \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\" (UID: \"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa\") "
Sep 17 01:57:17.115724 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115697    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" (UID: "bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:17.115843 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115765    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:17.115903 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.115842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" (UID: "2d4069dc-66bc-4680-85c7-be7cdbe4b3fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:17.117526 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.117502    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts" (OuterVolumeSpecName: "kube-api-access-5tlts") pod "2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" (UID: "2d4069dc-66bc-4680-85c7-be7cdbe4b3fa"). InnerVolumeSpecName "kube-api-access-5tlts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:17.117636 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.117547    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx" (OuterVolumeSpecName: "kube-api-access-2tffx") pod "bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" (UID: "bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad"). InnerVolumeSpecName "kube-api-access-2tffx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:17.216443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.216413    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tlts\" (UniqueName: \"kubernetes.io/projected/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-kube-api-access-5tlts\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:17.216443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.216441    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tffx\" (UniqueName: \"kubernetes.io/projected/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad-kube-api-access-2tffx\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:17.216443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.216451    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:17.799318 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.799286    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d31e704-fb2a-451d-a5b4-3b6e7999eef7" path="/var/lib/kubelet/pods/8d31e704-fb2a-451d-a5b4-3b6e7999eef7/volumes"
Sep 17 01:57:17.884957 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.884925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:17.928557 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.928526    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"
Sep 17 01:57:17.928727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.928561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj" event={"ID":"bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad","Type":"ContainerDied","Data":"ee3d797fad0b9e26bab32d70de3db3936f718637fdd9e215704ec44deb654cb9"}
Sep 17 01:57:17.928727 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.928637    2573 scope.go:117] "RemoveContainer" containerID="485128b478a3da82c19fc7d8148097668c32254e48dbe0f9291dbeea3a8b41fc"
Sep 17 01:57:17.930023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.929929    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"
Sep 17 01:57:17.930023 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.929965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2" event={"ID":"2d4069dc-66bc-4680-85c7-be7cdbe4b3fa","Type":"ContainerDied","Data":"0949e43a0b117958bc905837162e254be557cdad556ccfb6331d99ddc906a090"}
Sep 17 01:57:17.937276 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.937259    2573 scope.go:117] "RemoveContainer" containerID="7112eb57dc948d96cb786ebf6a4380bea5735fc358c92f7e6e732fb89f8352de"
Sep 17 01:57:17.946524 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.946502    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:57:17.950005 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.949984    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2"]
Sep 17 01:57:17.959635 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.959615    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:57:17.964146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:17.964124    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj"]
Sep 17 01:57:18.001927 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:18.001859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:19.573856 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:19.573805    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:57:19.799580 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:19.799541    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" path="/var/lib/kubelet/pods/2d4069dc-66bc-4680-85c7-be7cdbe4b3fa/volumes"
Sep 17 01:57:19.799941 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:19.799927    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" path="/var/lib/kubelet/pods/bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad/volumes"
Sep 17 01:57:23.092559 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.092522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:23.154690 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.154662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:23.347249 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.347159    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:57:23.347447 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.347386    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy" containerID="cri-o://ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328" gracePeriod=30
Sep 17 01:57:23.375414 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.375385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:23.698087 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698050    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"]
Sep 17 01:57:23.698411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698396    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" containerName="payload-processing"
Sep 17 01:57:23.698411 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698412    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" containerName="payload-processing"
Sep 17 01:57:23.698499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698422    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" containerName="payload-pre-processing"
Sep 17 01:57:23.698499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698428    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" containerName="payload-pre-processing"
Sep 17 01:57:23.698499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698444    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d31e704-fb2a-451d-a5b4-3b6e7999eef7" containerName="revoke-keys"
Sep 17 01:57:23.698499 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698449    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d31e704-fb2a-451d-a5b4-3b6e7999eef7" containerName="revoke-keys"
Sep 17 01:57:23.698633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698514    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d31e704-fb2a-451d-a5b4-3b6e7999eef7" containerName="revoke-keys"
Sep 17 01:57:23.698633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698523    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf39b2b5-0444-45d7-a8ae-0eb4f4db69ad" containerName="payload-processing"
Sep 17 01:57:23.698633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.698531    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4069dc-66bc-4680-85c7-be7cdbe4b3fa" containerName="payload-pre-processing"
Sep 17 01:57:23.702879 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.702858    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:23.705310 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.705286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r9tdk\""
Sep 17 01:57:23.707683 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.707655    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"]
Sep 17 01:57:23.877500 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.877466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6\" (UID: \"a0fad2d1-9a81-4b5c-acb7-d317eb428154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:23.978660 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.978578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6\" (UID: \"a0fad2d1-9a81-4b5c-acb7-d317eb428154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:23.979303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:23.979278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6\" (UID: \"a0fad2d1-9a81-4b5c-acb7-d317eb428154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:24.016795 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.016731    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:24.283603 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.283409    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"]
Sep 17 01:57:24.285758 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:57:24.285730    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fad2d1_9a81_4b5c_acb7_d317eb428154.slice/crio-8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de WatchSource:0}: Error finding container 8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de: Status 404 returned error can't find the container with id 8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de
Sep 17 01:57:24.331209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.331185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:24.843844 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.843744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:24.970741 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.970692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6" event={"ID":"a0fad2d1-9a81-4b5c-acb7-d317eb428154","Type":"ContainerStarted","Data":"9d6715cc531428a4a46c63b6ac88dd95076dd6eee898ec8f5b6cb21401853ded"}
Sep 17 01:57:24.970942 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.970810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6" event={"ID":"a0fad2d1-9a81-4b5c-acb7-d317eb428154","Type":"ContainerStarted","Data":"8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de"}
Sep 17 01:57:24.986662 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:24.986614    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6" podStartSLOduration=1.9865992110000001 podStartE2EDuration="1.986599211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:24.984971645 +0000 UTC m=+2143.629079749" watchObservedRunningTime="2026-09-17 01:57:24.986599211 +0000 UTC m=+2143.630707289"
Sep 17 01:57:25.976584 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:25.976550    2573 generic.go:356] "Generic (PLEG): container finished" podID="a0fad2d1-9a81-4b5c-acb7-d317eb428154" containerID="9d6715cc531428a4a46c63b6ac88dd95076dd6eee898ec8f5b6cb21401853ded" exitCode=0
Sep 17 01:57:25.976999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:25.976634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6" event={"ID":"a0fad2d1-9a81-4b5c-acb7-d317eb428154","Type":"ContainerDied","Data":"9d6715cc531428a4a46c63b6ac88dd95076dd6eee898ec8f5b6cb21401853ded"}
Sep 17 01:57:27.111533 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.111503    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:27.205657 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.205628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca\") pod \"a0fad2d1-9a81-4b5c-acb7-d317eb428154\" (UID: \"a0fad2d1-9a81-4b5c-acb7-d317eb428154\") "
Sep 17 01:57:27.206046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.206022    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0fad2d1-9a81-4b5c-acb7-d317eb428154" (UID: "a0fad2d1-9a81-4b5c-acb7-d317eb428154"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:27.306606 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.306519    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0fad2d1-9a81-4b5c-acb7-d317eb428154-maas-api-service-ca\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:27.987479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.987450    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"
Sep 17 01:57:27.987479 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.987472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6" event={"ID":"a0fad2d1-9a81-4b5c-acb7-d317eb428154","Type":"ContainerDied","Data":"8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de"}
Sep 17 01:57:27.987694 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:27.987526    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a4201a7a6b53fa8bfbbe4125a90a6289fdaaa581b768bc772142aeab8d274de"
Sep 17 01:57:28.600578 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.600554    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:57:28.718531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718456    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718531 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718508    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718609    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nns89\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718639    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718673    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718705    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.718752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.719088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718849    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs\") pod \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\" (UID: \"eecc7d6b-845a-4f39-b3ec-e992c9d1064c\") "
Sep 17 01:57:28.719088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718890    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:28.719088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data" (OuterVolumeSpecName: "istio-data") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:28.719088 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.718895    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719202    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istiod-ca-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719225    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719238    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-data\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719250    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-workload-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.719303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.719255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:28.720789 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.720743    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token" (OuterVolumeSpecName: "istio-token") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:28.720970 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.720953    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:28.721046 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.721020    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89" (OuterVolumeSpecName: "kube-api-access-nns89") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "kube-api-access-nns89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:28.721117 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.721096    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eecc7d6b-845a-4f39-b3ec-e992c9d1064c" (UID: "eecc7d6b-845a-4f39-b3ec-e992c9d1064c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:57:28.820029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.820004    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-credential-socket\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.820029 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.820024    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-envoy\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.820168 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.820033    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-token\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.820168 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.820041    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nns89\" (UniqueName: \"kubernetes.io/projected/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-kube-api-access-nns89\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.820168 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.820050    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eecc7d6b-845a-4f39-b3ec-e992c9d1064c-istio-podinfo\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:28.993742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.993667    2573 generic.go:356] "Generic (PLEG): container finished" podID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerID="ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328" exitCode=0
Sep 17 01:57:28.993742 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.993715    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"
Sep 17 01:57:28.993952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.993754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerDied","Data":"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"}
Sep 17 01:57:28.993952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.993832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps" event={"ID":"eecc7d6b-845a-4f39-b3ec-e992c9d1064c","Type":"ContainerDied","Data":"3cc1f0002b65d8f57ff82cb16bae5f397493baa7fed4404103b0cda25a2a027a"}
Sep 17 01:57:28.993952 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:28.993848    2573 scope.go:117] "RemoveContainer" containerID="ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"
Sep 17 01:57:29.003600 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.003586    2573 scope.go:117] "RemoveContainer" containerID="bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"
Sep 17 01:57:29.011365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.011349    2573 scope.go:117] "RemoveContainer" containerID="ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"
Sep 17 01:57:29.011605 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:57:29.011588    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328\": container with ID starting with ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328 not found: ID does not exist" containerID="ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"
Sep 17 01:57:29.011654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.011610    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328"} err="failed to get container status \"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328\": rpc error: code = NotFound desc = could not find container \"ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328\": container with ID starting with ed4eba2ccce9d1e7adfa10513af809a1888ca2a32f1d3e884f912b90860a9328 not found: ID does not exist"
Sep 17 01:57:29.011654 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.011625    2573 scope.go:117] "RemoveContainer" containerID="bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"
Sep 17 01:57:29.011895 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:57:29.011876    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592\": container with ID starting with bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592 not found: ID does not exist" containerID="bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"
Sep 17 01:57:29.011962 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.011906    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592"} err="failed to get container status \"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592\": rpc error: code = NotFound desc = could not find container \"bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592\": container with ID starting with bf2f16545fa8e5f6b12644516f36f24aa67fef6ad5666a6ab065ac903efc1592 not found: ID does not exist"
Sep 17 01:57:29.015703 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.015680    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:57:29.019382 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.019362    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps"]
Sep 17 01:57:29.798020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:29.797988    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" path="/var/lib/kubelet/pods/eecc7d6b-845a-4f39-b3ec-e992c9d1064c/volumes"
Sep 17 01:57:34.228242 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.228157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:34.244977 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.244945    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:57:34.245225 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.245199    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" podUID="dc2706e0-8295-49f3-97e6-433dc52d77cd" containerName="payload-processing" containerID="cri-o://2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888" gracePeriod=30
Sep 17 01:57:34.251141 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.251112    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:57:34.251516 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.251486    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" podUID="1604d921-510d-4525-9266-8a56a8a4f980" containerName="payload-pre-processing" containerID="cri-o://b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1" gracePeriod=30
Sep 17 01:57:34.291018 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.290991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:34.395288 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.395217    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:34.395700 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.395656    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"]
Sep 17 01:57:34.397209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.397181    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-361849-hbjh6"]
Sep 17 01:57:34.481346 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.481316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:34.506207 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.506180    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:57:34.535019 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.534991    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:57:34.564930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.564905    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume\") pod \"dc2706e0-8295-49f3-97e6-433dc52d77cd\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") "
Sep 17 01:57:34.565069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.564995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2lsj\" (UniqueName: \"kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj\") pod \"1604d921-510d-4525-9266-8a56a8a4f980\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") "
Sep 17 01:57:34.565069 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.565027    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c52jj\" (UniqueName: \"kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj\") pod \"dc2706e0-8295-49f3-97e6-433dc52d77cd\" (UID: \"dc2706e0-8295-49f3-97e6-433dc52d77cd\") "
Sep 17 01:57:34.565159 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.565077    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume\") pod \"1604d921-510d-4525-9266-8a56a8a4f980\" (UID: \"1604d921-510d-4525-9266-8a56a8a4f980\") "
Sep 17 01:57:34.565281 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.565258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc2706e0-8295-49f3-97e6-433dc52d77cd" (UID: "dc2706e0-8295-49f3-97e6-433dc52d77cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:34.565521 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.565499    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1604d921-510d-4525-9266-8a56a8a4f980" (UID: "1604d921-510d-4525-9266-8a56a8a4f980"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:34.567091 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.567069    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj" (OuterVolumeSpecName: "kube-api-access-c52jj") pod "dc2706e0-8295-49f3-97e6-433dc52d77cd" (UID: "dc2706e0-8295-49f3-97e6-433dc52d77cd"). InnerVolumeSpecName "kube-api-access-c52jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:34.567160 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.567106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj" (OuterVolumeSpecName: "kube-api-access-r2lsj") pod "1604d921-510d-4525-9266-8a56a8a4f980" (UID: "1604d921-510d-4525-9266-8a56a8a4f980"). InnerVolumeSpecName "kube-api-access-r2lsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:34.666567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.666531    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2lsj\" (UniqueName: \"kubernetes.io/projected/1604d921-510d-4525-9266-8a56a8a4f980-kube-api-access-r2lsj\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:34.666567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.666562    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c52jj\" (UniqueName: \"kubernetes.io/projected/dc2706e0-8295-49f3-97e6-433dc52d77cd-kube-api-access-c52jj\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:34.666567 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.666572    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1604d921-510d-4525-9266-8a56a8a4f980-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:34.666811 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.666581    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc2706e0-8295-49f3-97e6-433dc52d77cd-plugins-config-volume\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:34.789625 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.789555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:34.891083 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:34.891049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:35.025376 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.025339    2573 generic.go:356] "Generic (PLEG): container finished" podID="1604d921-510d-4525-9266-8a56a8a4f980" containerID="b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1" exitCode=0
Sep 17 01:57:35.025555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.025390    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"
Sep 17 01:57:35.025555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.025418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" event={"ID":"1604d921-510d-4525-9266-8a56a8a4f980","Type":"ContainerDied","Data":"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"}
Sep 17 01:57:35.025555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.025477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6" event={"ID":"1604d921-510d-4525-9266-8a56a8a4f980","Type":"ContainerDied","Data":"a5c6a7710ec711b04dbda85312e335e25c43bb5b8d0fdf3192bd1c770a218652"}
Sep 17 01:57:35.025555 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.025509    2573 scope.go:117] "RemoveContainer" containerID="b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"
Sep 17 01:57:35.026930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.026908    2573 generic.go:356] "Generic (PLEG): container finished" podID="dc2706e0-8295-49f3-97e6-433dc52d77cd" containerID="2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888" exitCode=0
Sep 17 01:57:35.026930 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.026923    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"
Sep 17 01:57:35.027115 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.026936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" event={"ID":"dc2706e0-8295-49f3-97e6-433dc52d77cd","Type":"ContainerDied","Data":"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"}
Sep 17 01:57:35.027115 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.026992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj" event={"ID":"dc2706e0-8295-49f3-97e6-433dc52d77cd","Type":"ContainerDied","Data":"d456b1d8075a5d7594d53895af5c03ea7fe578a83f721d3357b0b4b64c56f8f9"}
Sep 17 01:57:35.035458 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.035434    2573 scope.go:117] "RemoveContainer" containerID="b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"
Sep 17 01:57:35.035794 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:57:35.035762    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1\": container with ID starting with b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1 not found: ID does not exist" containerID="b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"
Sep 17 01:57:35.035860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.035800    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1"} err="failed to get container status \"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1\": rpc error: code = NotFound desc = could not find container \"b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1\": container with ID starting with b38fac9ea6de947b88513490aa87c5ef6edd3dba79699dd1821b099f14436ba1 not found: ID does not exist"
Sep 17 01:57:35.035860 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.035819    2573 scope.go:117] "RemoveContainer" containerID="2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"
Sep 17 01:57:35.047633 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.047610    2573 scope.go:117] "RemoveContainer" containerID="2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"
Sep 17 01:57:35.048087 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:57:35.048061    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888\": container with ID starting with 2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888 not found: ID does not exist" containerID="2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"
Sep 17 01:57:35.048194 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.048092    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888"} err="failed to get container status \"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888\": rpc error: code = NotFound desc = could not find container \"2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888\": container with ID starting with 2153bf0ff9e74d775fa8abe1a073b1d8d8da9d233214040665c6bcc6367e8888 not found: ID does not exist"
Sep 17 01:57:35.050402 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.050378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:57:35.053699 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.053676    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6"]
Sep 17 01:57:35.066737 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.066716    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:57:35.076022 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.075999    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj"]
Sep 17 01:57:35.798608 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.798570    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1604d921-510d-4525-9266-8a56a8a4f980" path="/var/lib/kubelet/pods/1604d921-510d-4525-9266-8a56a8a4f980/volumes"
Sep 17 01:57:35.798997 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.798917    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0fad2d1-9a81-4b5c-acb7-d317eb428154" path="/var/lib/kubelet/pods/a0fad2d1-9a81-4b5c-acb7-d317eb428154/volumes"
Sep 17 01:57:35.799244 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:35.799230    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2706e0-8295-49f3-97e6-433dc52d77cd" path="/var/lib/kubelet/pods/dc2706e0-8295-49f3-97e6-433dc52d77cd/volumes"
Sep 17 01:57:36.977133 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:36.977093    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:57:40.442316 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:40.442289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:40.540349 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:40.540319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:40.703819 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:40.703725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:57:42.243097 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:42.243066    2573 scope.go:117] "RemoveContainer" containerID="6fe2886ff28df72bd57f867edb7364671f398894478968d5b52961c56315f18b"
Sep 17 01:57:42.930836 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:42.930800    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:57:42.931020 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:42.930995    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-749bfb5bfc-svr62" podUID="75401b97-0e32-40df-9ec4-580910446846" containerName="manager" containerID="cri-o://c8c0b689e3da4e40643b9826a3da05d63e9ccc26da999e06c76e553f118a5e2b" gracePeriod=30
Sep 17 01:57:43.068379 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.068345    2573 generic.go:356] "Generic (PLEG): container finished" podID="75401b97-0e32-40df-9ec4-580910446846" containerID="c8c0b689e3da4e40643b9826a3da05d63e9ccc26da999e06c76e553f118a5e2b" exitCode=0
Sep 17 01:57:43.068506 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.068395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-svr62" event={"ID":"75401b97-0e32-40df-9ec4-580910446846","Type":"ContainerDied","Data":"c8c0b689e3da4e40643b9826a3da05d63e9ccc26da999e06c76e553f118a5e2b"}
Sep 17 01:57:43.172559 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.172533    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:57:43.240237 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.240158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4cm2\" (UniqueName: \"kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2\") pod \"75401b97-0e32-40df-9ec4-580910446846\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") "
Sep 17 01:57:43.240365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.240262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs\") pod \"75401b97-0e32-40df-9ec4-580910446846\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") "
Sep 17 01:57:43.240365 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.240287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert\") pod \"75401b97-0e32-40df-9ec4-580910446846\" (UID: \"75401b97-0e32-40df-9ec4-580910446846\") "
Sep 17 01:57:43.242298 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.242261    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "75401b97-0e32-40df-9ec4-580910446846" (UID: "75401b97-0e32-40df-9ec4-580910446846"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:57:43.242443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.242364    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "75401b97-0e32-40df-9ec4-580910446846" (UID: "75401b97-0e32-40df-9ec4-580910446846"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:57:43.242443 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.242430    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2" (OuterVolumeSpecName: "kube-api-access-d4cm2") pod "75401b97-0e32-40df-9ec4-580910446846" (UID: "75401b97-0e32-40df-9ec4-580910446846"). InnerVolumeSpecName "kube-api-access-d4cm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:43.341745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.341713    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-metrics-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:43.341745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.341740    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75401b97-0e32-40df-9ec4-580910446846-webhook-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:43.341745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:43.341749    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4cm2\" (UniqueName: \"kubernetes.io/projected/75401b97-0e32-40df-9ec4-580910446846-kube-api-access-d4cm2\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:57:44.074161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.074076    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-svr62"
Sep 17 01:57:44.074161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.074082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-svr62" event={"ID":"75401b97-0e32-40df-9ec4-580910446846","Type":"ContainerDied","Data":"40ee25010092aafc8acd9a44fc03692a005f3f114a95058709419490ace24447"}
Sep 17 01:57:44.074161 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.074148    2573 scope.go:117] "RemoveContainer" containerID="c8c0b689e3da4e40643b9826a3da05d63e9ccc26da999e06c76e553f118a5e2b"
Sep 17 01:57:44.090275 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.090246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:57:44.093369 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.093346    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-svr62"]
Sep 17 01:57:44.679381 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:44.679346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:57:45.798416 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:57:45.798382    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75401b97-0e32-40df-9ec4-580910446846" path="/var/lib/kubelet/pods/75401b97-0e32-40df-9ec4-580910446846/volumes"
Sep 17 01:58:42.285417 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:42.285383    2573 scope.go:117] "RemoveContainer" containerID="8ea47faa069db604c9c8faa32c3d64cab74349f558b78be8315bc4de3a7784eb"
Sep 17 01:58:42.293611 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:42.293586    2573 scope.go:117] "RemoveContainer" containerID="7b5ba32218a5da8acdc24a22d284d5acd08fdba2da38ba0528e594d4164b76eb"
Sep 17 01:58:42.300724 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:42.300696    2573 scope.go:117] "RemoveContainer" containerID="f607defbd89bf36019d35a9df0cee4371257adb6fb2be5beae8f11e7d4b6d2bf"
Sep 17 01:58:44.938792 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.938746    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939065    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939078    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939094    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1604d921-510d-4525-9266-8a56a8a4f980" containerName="payload-pre-processing"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939099    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1604d921-510d-4525-9266-8a56a8a4f980" containerName="payload-pre-processing"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939113    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fad2d1-9a81-4b5c-acb7-d317eb428154" containerName="revoke-keys"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939118    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fad2d1-9a81-4b5c-acb7-d317eb428154" containerName="revoke-keys"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939124    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939129    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939138    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75401b97-0e32-40df-9ec4-580910446846" containerName="manager"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939142    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="75401b97-0e32-40df-9ec4-580910446846" containerName="manager"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939149    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2706e0-8295-49f3-97e6-433dc52d77cd" containerName="payload-processing"
Sep 17 01:58:44.939177 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939154    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2706e0-8295-49f3-97e6-433dc52d77cd" containerName="payload-processing"
Sep 17 01:58:44.939563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939202    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="75401b97-0e32-40df-9ec4-580910446846" containerName="manager"
Sep 17 01:58:44.939563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939211    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:58:44.939563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939217    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fad2d1-9a81-4b5c-acb7-d317eb428154" containerName="revoke-keys"
Sep 17 01:58:44.939563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939223    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2706e0-8295-49f3-97e6-433dc52d77cd" containerName="payload-processing"
Sep 17 01:58:44.939563 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.939229    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1604d921-510d-4525-9266-8a56a8a4f980" containerName="payload-pre-processing"
Sep 17 01:58:44.945146 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.945099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:44.948745 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.948716    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:58:44.948914 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.948883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:58:44.949006 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.948987    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:58:44.949287 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.949264    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fwpg7\""
Sep 17 01:58:44.950730 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:44.950708    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:58:45.034601 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.034573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.034752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.034607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvntp\" (UniqueName: \"kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.034752 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.034626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.135723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.135683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.135723 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.135726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvntp\" (UniqueName: \"kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.135944 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.135748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.138105 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.138079    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.138240 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.138187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.142999 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.142975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvntp\" (UniqueName: \"kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp\") pod \"maas-controller-749bfb5bfc-d5f8p\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") " pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.256931 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.256860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:45.525629 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.525604    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:58:45.528166 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:58:45.528141    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb747ba82_c369_45ae_9f7c_6dac3c737ed0.slice/crio-7f8f1837654e2236b15e7dfd0310a3b228cb925708d07287c54e833edcdb20b6 WatchSource:0}: Error finding container 7f8f1837654e2236b15e7dfd0310a3b228cb925708d07287c54e833edcdb20b6: Status 404 returned error can't find the container with id 7f8f1837654e2236b15e7dfd0310a3b228cb925708d07287c54e833edcdb20b6
Sep 17 01:58:45.529849 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:45.529830    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:58:46.353209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:46.353113    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" event={"ID":"b747ba82-c369-45ae-9f7c-6dac3c737ed0","Type":"ContainerStarted","Data":"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"}
Sep 17 01:58:46.353209 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:46.353177    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" event={"ID":"b747ba82-c369-45ae-9f7c-6dac3c737ed0","Type":"ContainerStarted","Data":"7f8f1837654e2236b15e7dfd0310a3b228cb925708d07287c54e833edcdb20b6"}
Sep 17 01:58:46.353591 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:46.353227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:58:46.369969 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:46.369927    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" podStartSLOduration=1.971528915 podStartE2EDuration="2.369912638s" totalImagesPullingTime="398.383723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:58:46.369233717 +0000 UTC m=+2225.013341821" watchObservedRunningTime="2026-09-17 01:58:46.369912638 +0000 UTC m=+2225.014020716"
Sep 17 01:58:57.362014 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:58:57.361982    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:59:05.190470 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:05.190385    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:59:06.676485 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:06.676446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:59:06.760396 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:06.760364    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:59:06.760605 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:06.760585    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" podUID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" containerName="manager" containerID="cri-o://4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611" gracePeriod=30
Sep 17 01:59:07.006509 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.006485    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:59:07.124394 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.124333    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvntp\" (UniqueName: \"kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp\") pod \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") "
Sep 17 01:59:07.124597 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.124429    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs\") pod \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") "
Sep 17 01:59:07.124597 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.124487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert\") pod \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\" (UID: \"b747ba82-c369-45ae-9f7c-6dac3c737ed0\") "
Sep 17 01:59:07.126512 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.126484    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b747ba82-c369-45ae-9f7c-6dac3c737ed0" (UID: "b747ba82-c369-45ae-9f7c-6dac3c737ed0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:59:07.126617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.126564    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b747ba82-c369-45ae-9f7c-6dac3c737ed0" (UID: "b747ba82-c369-45ae-9f7c-6dac3c737ed0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:59:07.126617 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.126581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp" (OuterVolumeSpecName: "kube-api-access-rvntp") pod "b747ba82-c369-45ae-9f7c-6dac3c737ed0" (UID: "b747ba82-c369-45ae-9f7c-6dac3c737ed0"). InnerVolumeSpecName "kube-api-access-rvntp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:59:07.226003 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.225966    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvntp\" (UniqueName: \"kubernetes.io/projected/b747ba82-c369-45ae-9f7c-6dac3c737ed0-kube-api-access-rvntp\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:59:07.226003 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.225997    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-metrics-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:59:07.226003 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.226010    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b747ba82-c369-45ae-9f7c-6dac3c737ed0-webhook-cert\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 01:59:07.449653 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.449619    2573 generic.go:356] "Generic (PLEG): container finished" podID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" containerID="4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611" exitCode=0
Sep 17 01:59:07.449871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.449669    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p"
Sep 17 01:59:07.449871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.449712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" event={"ID":"b747ba82-c369-45ae-9f7c-6dac3c737ed0","Type":"ContainerDied","Data":"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"}
Sep 17 01:59:07.449871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.449785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-d5f8p" event={"ID":"b747ba82-c369-45ae-9f7c-6dac3c737ed0","Type":"ContainerDied","Data":"7f8f1837654e2236b15e7dfd0310a3b228cb925708d07287c54e833edcdb20b6"}
Sep 17 01:59:07.449871 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.449821    2573 scope.go:117] "RemoveContainer" containerID="4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"
Sep 17 01:59:07.458814 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.458794    2573 scope.go:117] "RemoveContainer" containerID="4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"
Sep 17 01:59:07.459110 ip-10-0-136-54 kubenswrapper[2573]: E0917 01:59:07.459088    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611\": container with ID starting with 4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611 not found: ID does not exist" containerID="4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"
Sep 17 01:59:07.459172 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.459119    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611"} err="failed to get container status \"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611\": rpc error: code = NotFound desc = could not find container \"4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611\": container with ID starting with 4867da46c1a834bade9a5c38996084e44b4eced9c956fd319d1b528b76eba611 not found: ID does not exist"
Sep 17 01:59:07.470355 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.470321    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:59:07.473677 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.473653    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-d5f8p"]
Sep 17 01:59:07.798576 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:07.798491    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" path="/var/lib/kubelet/pods/b747ba82-c369-45ae-9f7c-6dac3c737ed0/volumes"
Sep 17 01:59:08.189303 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.189266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 01:59:08.304228 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.304197    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-fx9hh"]
Sep 17 01:59:08.304519 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.304507    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" containerName="manager"
Sep 17 01:59:08.304574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.304521    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" containerName="manager"
Sep 17 01:59:08.304574 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.304572    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b747ba82-c369-45ae-9f7c-6dac3c737ed0" containerName="manager"
Sep 17 01:59:08.304639 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.304581    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="eecc7d6b-845a-4f39-b3ec-e992c9d1064c" containerName="istio-proxy"
Sep 17 01:59:08.308797 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.308760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.312265 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.312244    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:59:08.312406 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.312358    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:59:08.312472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.312439    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:59:08.312472 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.312360    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fwpg7\""
Sep 17 01:59:08.318544 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.318519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-fx9hh"]
Sep 17 01:59:08.437896 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.437850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-metrics-certs\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.438079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.437966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgcj\" (UniqueName: \"kubernetes.io/projected/b4d949b4-e51d-4e97-a280-ead4987450a6-kube-api-access-tcgcj\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.438079 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.438002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-webhook-cert\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.538837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.538707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgcj\" (UniqueName: \"kubernetes.io/projected/b4d949b4-e51d-4e97-a280-ead4987450a6-kube-api-access-tcgcj\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.538837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.538751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-webhook-cert\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.538837 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.538813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-metrics-certs\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.541269 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.541237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-webhook-cert\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.541423 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.541271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d949b4-e51d-4e97-a280-ead4987450a6-metrics-certs\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.547602 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.547578    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgcj\" (UniqueName: \"kubernetes.io/projected/b4d949b4-e51d-4e97-a280-ead4987450a6-kube-api-access-tcgcj\") pod \"maas-controller-749bfb5bfc-fx9hh\" (UID: \"b4d949b4-e51d-4e97-a280-ead4987450a6\") " pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.620015 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.619987    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:08.888195 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:08.888167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-749bfb5bfc-fx9hh"]
Sep 17 01:59:08.889950 ip-10-0-136-54 kubenswrapper[2573]: W0917 01:59:08.889916    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d949b4_e51d_4e97_a280_ead4987450a6.slice/crio-2a545888fb6c306a6e1a46dd434fec5c5071a55223de140f95a775cc7663b804 WatchSource:0}: Error finding container 2a545888fb6c306a6e1a46dd434fec5c5071a55223de140f95a775cc7663b804: Status 404 returned error can't find the container with id 2a545888fb6c306a6e1a46dd434fec5c5071a55223de140f95a775cc7663b804
Sep 17 01:59:09.461584 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:09.461547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh" event={"ID":"b4d949b4-e51d-4e97-a280-ead4987450a6","Type":"ContainerStarted","Data":"0624ad4581045393c4c2f60a64b75bc53fea2eee4131fcbeada98e751dcf60f6"}
Sep 17 01:59:09.461738 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:09.461603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh" event={"ID":"b4d949b4-e51d-4e97-a280-ead4987450a6","Type":"ContainerStarted","Data":"2a545888fb6c306a6e1a46dd434fec5c5071a55223de140f95a775cc7663b804"}
Sep 17 01:59:09.461839 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:09.461748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:09.479049 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:09.479000    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh" podStartSLOduration=1.139892964 podStartE2EDuration="1.478984163s" totalImagesPullingTime="339.091199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:59:09.476508714 +0000 UTC m=+2248.120616804" watchObservedRunningTime="2026-09-17 01:59:09.478984163 +0000 UTC m=+2248.123092297"
Sep 17 01:59:20.468697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:20.468659    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-749bfb5bfc-fx9hh"
Sep 17 01:59:32.370190 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:32.370153    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:59:40.665520 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:40.665489    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:59:48.976345 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:48.976310    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 01:59:56.622697 ip-10-0-136-54 kubenswrapper[2573]: I0917 01:59:56.622661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:00:00.329811 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:00:00.329731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:00:03.770171 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:00:03.770138    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:00:10.683489 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:00:10.683455    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:00:17.629102 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:00:17.629066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:22.066493 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:22.066446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:22.125351 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:22.125320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:37.968608 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:37.968571    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:01:42.345365 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:42.345326    2573 scope.go:117] "RemoveContainer" containerID="c28dcc19d1026cc6a2e99d47f7ad3171f8bf476ebb22760b2c4ef51fe3035361"
Sep 17 02:01:43.767244 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:43.767207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:01:52.872551 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:52.872520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:01:53.792264 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:53.792235    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:54.051537 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:54.051410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:54.106313 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:54.106276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:01:58.709790 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:01:58.709732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:02:00.178526 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:00.178487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:02:02.560524 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.560484    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:02.564065 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.564044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.566518 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.566493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4517c39a-kserve-self-signed-certs\""
Sep 17 02:02:02.580521 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.580492    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:02.597960 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.597935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:02:02.750862 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.750824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.750862 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.750862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.751053 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.750880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.751053 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.750945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.751053 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.751015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9wg\" (UniqueName: \"kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.751156 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.751084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851687 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851687 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851687 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851687 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851973 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851705    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9wg\" (UniqueName: \"kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.851973 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.851747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.852134 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.852110    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.852183 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.852165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.852247 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.852215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.854082 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.854061    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.854236 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.854217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.859627 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.859605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9wg\" (UniqueName: \"kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg\") pod \"e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") " pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:02.873612 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:02.873578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:03.143983 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:03.143950    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:03.146862 ip-10-0-136-54 kubenswrapper[2573]: W0917 02:02:03.146818    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddef46c1e_a3e4_4185_913e_ade4f10fbd80.slice/crio-5c220e0d7fab650ad2dee6946a752c8512f6806b06b04a88b6bb7bd4fe41cab7 WatchSource:0}: Error finding container 5c220e0d7fab650ad2dee6946a752c8512f6806b06b04a88b6bb7bd4fe41cab7: Status 404 returned error can't find the container with id 5c220e0d7fab650ad2dee6946a752c8512f6806b06b04a88b6bb7bd4fe41cab7
Sep 17 02:02:03.251575 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:03.251546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" event={"ID":"def46c1e-a3e4-4185-913e-ade4f10fbd80","Type":"ContainerStarted","Data":"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"}
Sep 17 02:02:03.251699 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:03.251584    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" event={"ID":"def46c1e-a3e4-4185-913e-ade4f10fbd80","Type":"ContainerStarted","Data":"5c220e0d7fab650ad2dee6946a752c8512f6806b06b04a88b6bb7bd4fe41cab7"}
Sep 17 02:02:03.274556 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:03.274501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" podStartSLOduration=1.274485135 podStartE2EDuration="1.274485135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:02:03.273536795 +0000 UTC m=+2421.917644874" watchObservedRunningTime="2026-09-17 02:02:03.274485135 +0000 UTC m=+2421.918593214"
Sep 17 02:02:10.475828 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:10.475747    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:02:12.874334 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:12.874299    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:12.874751 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:12.874349    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:12.886991 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:12.886966    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:13.312019 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:13.311937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:35.746287 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:35.746255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:02:36.586323 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:36.586288    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:37.029091 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:37.029055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:02:39.178095 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:39.178060    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:02:42.364743 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:42.364703    2573 scope.go:117] "RemoveContainer" containerID="8023bcaf8b09be358fd2837915450c388685ba8b2ecc46058bf123446407f7c1"
Sep 17 02:02:48.770093 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:48.770056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:02:51.606228 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.606189    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" podUID="def46c1e-a3e4-4185-913e-ade4f10fbd80" containerName="main" containerID="cri-o://ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47" gracePeriod=45
Sep 17 02:02:51.845989 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.845965    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:51.953045 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.952966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953195 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953048    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953195 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953079    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953195 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953113    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj9wg\" (UniqueName: \"kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953195 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953195 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953161    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir\") pod \"def46c1e-a3e4-4185-913e-ade4f10fbd80\" (UID: \"def46c1e-a3e4-4185-913e-ade4f10fbd80\") "
Sep 17 02:02:51.953475 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953252    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home" (OuterVolumeSpecName: "home") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:02:51.953475 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953343    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache" (OuterVolumeSpecName: "model-cache") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:02:51.953599 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953474    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:02:51.953599 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953532    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-model-cache\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:51.953599 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.953550    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-home\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:51.955328 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.955294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm" (OuterVolumeSpecName: "dshm") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:02:51.955449 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.955359    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:02:51.955449 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:51.955393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg" (OuterVolumeSpecName: "kube-api-access-gj9wg") pod "def46c1e-a3e4-4185-913e-ade4f10fbd80" (UID: "def46c1e-a3e4-4185-913e-ade4f10fbd80"). InnerVolumeSpecName "kube-api-access-gj9wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:02:52.054902 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.054871    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-tmp-dir\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:52.054902 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.054897    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def46c1e-a3e4-4185-913e-ade4f10fbd80-tls-certs\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:52.055077 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.054913    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj9wg\" (UniqueName: \"kubernetes.io/projected/def46c1e-a3e4-4185-913e-ade4f10fbd80-kube-api-access-gj9wg\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:52.055077 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.054927    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/def46c1e-a3e4-4185-913e-ade4f10fbd80-dshm\") on node \"ip-10-0-136-54.ec2.internal\" DevicePath \"\""
Sep 17 02:02:52.475445 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.475411    2573 generic.go:356] "Generic (PLEG): container finished" podID="def46c1e-a3e4-4185-913e-ade4f10fbd80" containerID="ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47" exitCode=0
Sep 17 02:02:52.475632 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.475454    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"
Sep 17 02:02:52.475632 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.475502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" event={"ID":"def46c1e-a3e4-4185-913e-ade4f10fbd80","Type":"ContainerDied","Data":"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"}
Sep 17 02:02:52.475632 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.475551    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv" event={"ID":"def46c1e-a3e4-4185-913e-ade4f10fbd80","Type":"ContainerDied","Data":"5c220e0d7fab650ad2dee6946a752c8512f6806b06b04a88b6bb7bd4fe41cab7"}
Sep 17 02:02:52.475632 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.475573    2573 scope.go:117] "RemoveContainer" containerID="ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"
Sep 17 02:02:52.483918 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.483886    2573 scope.go:117] "RemoveContainer" containerID="ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"
Sep 17 02:02:52.484183 ip-10-0-136-54 kubenswrapper[2573]: E0917 02:02:52.484165    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47\": container with ID starting with ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47 not found: ID does not exist" containerID="ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"
Sep 17 02:02:52.484221 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.484191    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47"} err="failed to get container status \"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47\": rpc error: code = NotFound desc = could not find container \"ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47\": container with ID starting with ce77a0e150dbae478bddce48845248b105878e66baead7a9dd83acf0fc6bbf47 not found: ID does not exist"
Sep 17 02:02:52.495473 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.495450    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:52.500591 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:52.500571    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4517c39a-kserve-848fb6b759-28vbv"]
Sep 17 02:02:53.798439 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:53.798409    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def46c1e-a3e4-4185-913e-ade4f10fbd80" path="/var/lib/kubelet/pods/def46c1e-a3e4-4185-913e-ade4f10fbd80/volumes"
Sep 17 02:02:54.852048 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:54.852013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:02:56.068899 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:02:56.068861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:03:03.372322 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:03.372281    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:03:10.466448 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:10.466391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:03:16.182950 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:16.182919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:03:23.070672 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:23.070636    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xr2mk"]
Sep 17 02:03:26.320530 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:26.320490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:03:26.424196 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:26.424165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log" limit=1024
Sep 17 02:03:29.122536 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:29.122503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2sqwh_869146e5-a15c-4b31-8e1d-6bbcf7cc21f3/global-pull-secret-syncer/0.log"
Sep 17 02:03:29.267164 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:29.267133    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5tbrn_21a88fb2-87c8-48c9-ba3f-b9111796aba1/konnectivity-agent/0.log"
Sep 17 02:03:29.374832 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:29.374750    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-54.ec2.internal_27f1f42501049c1b81a90668ada60c8b/haproxy/0.log"
Sep 17 02:03:34.789420 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:34.789342    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xr2mk_2871b6b0-4f01-4fc1-88b4-3756d5c1ff8f/limitador/0.log"
Sep 17 02:03:36.757910 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:36.757884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwnw_ccdcb991-fb29-44a8-8417-944283f102f7/node-exporter/0.log"
Sep 17 02:03:36.789025 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:36.788994    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwnw_ccdcb991-fb29-44a8-8417-944283f102f7/kube-rbac-proxy/0.log"
Sep 17 02:03:36.839790 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:36.839746    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwnw_ccdcb991-fb29-44a8-8417-944283f102f7/init-textfile/0.log"
Sep 17 02:03:38.980888 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:38.980853    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-8l7t6_12ab0904-be5b-4ed1-a35b-447585b6bd17/networking-console-plugin/0.log"
Sep 17 02:03:39.523154 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.523120    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"]
Sep 17 02:03:39.523457 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.523445    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def46c1e-a3e4-4185-913e-ade4f10fbd80" containerName="main"
Sep 17 02:03:39.523511 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.523459    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="def46c1e-a3e4-4185-913e-ade4f10fbd80" containerName="main"
Sep 17 02:03:39.523547 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.523519    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="def46c1e-a3e4-4185-913e-ade4f10fbd80" containerName="main"
Sep 17 02:03:39.526733 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.526711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.529059 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.529035    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7tqq\"/\"kube-root-ca.crt\""
Sep 17 02:03:39.530198 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.530173    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7tqq\"/\"openshift-service-ca.crt\""
Sep 17 02:03:39.530198 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.530204    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r7tqq\"/\"default-dockercfg-t8545\""
Sep 17 02:03:39.537514 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.537494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"]
Sep 17 02:03:39.652128 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.652095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgf52\" (UniqueName: \"kubernetes.io/projected/fee5b310-96c7-40e2-ab27-9b5fb18947f6-kube-api-access-fgf52\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.652299 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.652138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-proc\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.652299 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.652165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-sys\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.652299 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.652233    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-lib-modules\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.652406 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.652300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-podres\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753428 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-sys\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-lib-modules\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-podres\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgf52\" (UniqueName: \"kubernetes.io/projected/fee5b310-96c7-40e2-ab27-9b5fb18947f6-kube-api-access-fgf52\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753520    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-proc\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753520    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-sys\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-lib-modules\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753621 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-proc\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.753872 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.753625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fee5b310-96c7-40e2-ab27-9b5fb18947f6-podres\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.760898 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.760871    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgf52\" (UniqueName: \"kubernetes.io/projected/fee5b310-96c7-40e2-ab27-9b5fb18947f6-kube-api-access-fgf52\") pod \"perf-node-gather-daemonset-6ghww\" (UID: \"fee5b310-96c7-40e2-ab27-9b5fb18947f6\") " pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:39.836295 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:39.836238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:40.103762 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:40.103738    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"]
Sep 17 02:03:40.105644 ip-10-0-136-54 kubenswrapper[2573]: W0917 02:03:40.105616    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfee5b310_96c7_40e2_ab27_9b5fb18947f6.slice/crio-d66bab847b506db897cd3580594a3655cf44e38637d99da5388d0413e62903fe WatchSource:0}: Error finding container d66bab847b506db897cd3580594a3655cf44e38637d99da5388d0413e62903fe: Status 404 returned error can't find the container with id d66bab847b506db897cd3580594a3655cf44e38637d99da5388d0413e62903fe
Sep 17 02:03:40.696365 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:40.696328    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww" event={"ID":"fee5b310-96c7-40e2-ab27-9b5fb18947f6","Type":"ContainerStarted","Data":"a3f74bf1529a649f2da80db273dc78e4b76040bda25195106e52bf8bd873a24b"}
Sep 17 02:03:40.696574 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:40.696382    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww" event={"ID":"fee5b310-96c7-40e2-ab27-9b5fb18947f6","Type":"ContainerStarted","Data":"d66bab847b506db897cd3580594a3655cf44e38637d99da5388d0413e62903fe"}
Sep 17 02:03:40.696574 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:40.696421    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:40.711532 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:40.711488    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww" podStartSLOduration=1.7114759880000001 podStartE2EDuration="1.711475988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:03:40.709970128 +0000 UTC m=+2519.354078238" watchObservedRunningTime="2026-09-17 02:03:40.711475988 +0000 UTC m=+2519.355584066"
Sep 17 02:03:41.871115 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:41.871093    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-656wz_c325a389-3781-4221-ac3f-f803aa9416af/dns/0.log"
Sep 17 02:03:41.890666 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:41.890639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-656wz_c325a389-3781-4221-ac3f-f803aa9416af/kube-rbac-proxy/0.log"
Sep 17 02:03:42.000193 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:42.000159    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7wvg_bba43f8d-2032-489d-b1cc-36543b391759/dns-node-resolver/0.log"
Sep 17 02:03:42.383032 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:42.383003    2573 scope.go:117] "RemoveContainer" containerID="5beec6a77c04ff04b2f030760d01c63870a5eb723faf1950ca4982054b9e074a"
Sep 17 02:03:42.392341 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:42.392299    2573 scope.go:117] "RemoveContainer" containerID="9d6715cc531428a4a46c63b6ac88dd95076dd6eee898ec8f5b6cb21401853ded"
Sep 17 02:03:42.401349 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:42.401329    2573 scope.go:117] "RemoveContainer" containerID="de9ff30754591b91c4e65b57451b6e7cf41dc8807cd923d0876ebd0d41f5d5b5"
Sep 17 02:03:42.598787 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:42.598756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sm6vk_7db90a84-dd5b-404b-bcc1-45a213c48f04/node-ca/0.log"
Sep 17 02:03:43.857208 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:43.857176    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b92x9_a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0/discovery/0.log"
Sep 17 02:03:43.902306 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:43.902283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c5f54bcb9-mmxtz_979374ce-fbd1-4aee-8296-dc327e265c62/kube-auth-proxy/0.log"
Sep 17 02:03:43.930473 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:43.930422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/0.log"
Sep 17 02:03:43.932553 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:43.932530    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/1.log"
Sep 17 02:03:44.843858 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:44.843825    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k8hs9_aa39d415-f721-48d1-b297-3b445b7ca064/serve-healthcheck-canary/0.log"
Sep 17 02:03:45.404462 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:45.404433    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns6ht_68988d36-dad1-4abd-bfa7-695b1fa0cadc/kube-rbac-proxy/0.log"
Sep 17 02:03:45.424730 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:45.424709    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns6ht_68988d36-dad1-4abd-bfa7-695b1fa0cadc/exporter/0.log"
Sep 17 02:03:45.443589 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:45.443571    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns6ht_68988d36-dad1-4abd-bfa7-695b1fa0cadc/extractor/0.log"
Sep 17 02:03:46.709443 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:46.709412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r7tqq/perf-node-gather-daemonset-6ghww"
Sep 17 02:03:47.583133 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:47.583090    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qhxlj_375db05b-cad3-4312-acd1-03c1d90297e6/manager/0.log"
Sep 17 02:03:47.802041 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:47.802013    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jq455_3fe56468-86fa-4fdb-a54b-25942b3c9949/manager/0.log"
Sep 17 02:03:47.852601 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:47.852527    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-749bfb5bfc-fx9hh_b4d949b4-e51d-4e97-a280-ead4987450a6/manager/0.log"
Sep 17 02:03:48.027649 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:48.027617    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c6978585-466dj_66a25ffb-26b7-48b4-90ee-e59980c51937/manager/0.log"
Sep 17 02:03:48.048976 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:48.048950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c6978585-466dj_66a25ffb-26b7-48b4-90ee-e59980c51937/copy-manifests/0.log"
Sep 17 02:03:50.773568 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:50.773542    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b92x9_a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0/discovery/0.log"
Sep 17 02:03:50.800755 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:50.800728    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c5f54bcb9-mmxtz_979374ce-fbd1-4aee-8296-dc327e265c62/kube-auth-proxy/0.log"
Sep 17 02:03:50.819000 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:50.818976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/0.log"
Sep 17 02:03:50.821594 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:50.821576    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/1.log"
Sep 17 02:03:52.682813 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:52.682782    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b92x9_a7bd0c38-3ad0-4a0f-8058-fe96aae22bc0/discovery/0.log"
Sep 17 02:03:52.718596 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:52.718572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c5f54bcb9-mmxtz_979374ce-fbd1-4aee-8296-dc327e265c62/kube-auth-proxy/0.log"
Sep 17 02:03:52.747079 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:52.747058    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/0.log"
Sep 17 02:03:52.749552 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:52.749534    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nld96_d7db02d2-f8ec-4e09-ab3d-24685d2892a6/istio-proxy/1.log"
Sep 17 02:03:56.332262 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.332232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6w8sw_9aaaaeb0-ad83-4a1f-aaa9-e584fc804018/kube-multus/0.log"
Sep 17 02:03:56.623227 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.623197    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/kube-multus-additional-cni-plugins/0.log"
Sep 17 02:03:56.644446 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.644420    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/egress-router-binary-copy/0.log"
Sep 17 02:03:56.662977 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.662958    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/cni-plugins/0.log"
Sep 17 02:03:56.683673 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.683654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/bond-cni-plugin/0.log"
Sep 17 02:03:56.701911 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.701892    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/routeoverride-cni/0.log"
Sep 17 02:03:56.725045 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.725029    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/whereabouts-cni-bincopy/0.log"
Sep 17 02:03:56.745054 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.745037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2zw4_4509e74e-a96f-45ec-a4dc-89223bed1c78/whereabouts-cni/0.log"
Sep 17 02:03:56.867641 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.867612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-85vss_8c3c5fcf-0d87-459b-8ae4-c687356b9bdc/network-metrics-daemon/0.log"
Sep 17 02:03:56.884721 ip-10-0-136-54 kubenswrapper[2573]: I0917 02:03:56.884658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-85vss_8c3c5fcf-0d87-459b-8ae4-c687356b9bdc/kube-rbac-proxy/0.log"